Methods and apparatus for displaying images

ABSTRACT

Methods and apparatus for using a display in a manner which results in a user perceiving a higher resolution than would be perceived if a user viewed the display from a head on position are described. In some embodiments one or more displays are mounted at an angle, e.g., sometimes in range a range from an angle above 0 degrees to 45 relative to a user&#39;s face and thus eyes. The user sees more pixels, e.g., dots corresponding to light emitting elements, per square inch of eye area than the user would see if the user were viewing the display head on due to the angle at which the display or displays are mounted. The methods and display mounting arrangement are well suited for use in head mounted displays, e.g., Virtual Reality (VR) displays for stereoscopic viewing (e.g., 3D) and/or non-stereoscopic viewing of displayed images.

RELATED APPLICATIONS

The present application claims the benefit of U.S. Provisional PatentApplication Ser. No. 62/481,457 filed Apr. 4, 2017.

FIELD

The present invention relates to methods and apparatus for displayimages, and more particularly, to methods and apparatus related toincreased perceived pixel density.

BACKGROUND

The size of an individual pixel, e.g., pixel element, on a display issubject to physical limitations of the display. As a result, theresolution that can be presented to a user in dots per inch of a displayscreen is limited physically.

Normally display screens are viewed by a user with the user lookingdirectly at the display screen. Thus, most systems which use a flatscreen are designed to be viewed with a user's head perpendicular to thedisplay screen. In such a case a line extending from the user's eyes tothe display screen would be at 90 degrees to the display screen. WithLCD and/or LED displays, the perceived image quality normally degradessomewhat as the angle at which a screen is viewed deviates from astraight on view of the screen. However, the range of viewing angleswhich produce what are often considered acceptable has increased so thatwith many newer displays a range of viewing angles can be supported.Thus a person to the side of a large screen TV may still have asatisfactory viewing experience in many cases.

While improvements in display screens have increased, the range ofviewing angles which provide acceptable viewing results, the dot pitchof screens, and thus the minimum size of pixels on a display, remains aconstraint on the quality a user will perceive. In the case of smallscreens which are placed near a user's eye, e.g., as part of a virtualreality (VR) headset, the physical limitations on dot pitch can limitthe resolution of an image when the screen is viewed head on which isnormally the case.

In view of the above discussion, it should be appreciated that there isa need for methods and/or apparatus which allow for improved viewingexperiences.

SUMMARY

In various embodiments one or more display screens are mounted at anangle or angles relative to a user's intended viewing position so thatwhen viewed, a user will intentionally see the display at anon-perpendicular angle to the user's eye or eyes. From the perspectiveof the viewer, for a given horizontal distance left to right observed bythe user's eye, the user will observe more pixel elements of the displaythan the user would observe if the user were viewing the angle dead on,e.g., at a 90 degree viewing angle. This results in an increasedperceived pixel density as compared to what would be observed if thescreen were viewed dead on. Thus, by controlling the mounting andviewing arrangement, a user can perceive the screen as having a higherpixel density and resolution than would be perceived if the screen wereviewed head on. This results in what can be called a perceived screenresolution which is higher than the actual display resolution.

The methods and apparatus of the present invention are particularly wellsuited for use in a head mounted display device but are not limited tosuch applications. In the case of a head mounted display, the depth ofthe display is often not critical and thus the increased depth requiredto allow for mounting a display at an angle is not a significant factorin device acceptability.

An exemplary system, in accordance with various embodiments, includes aheadmount assembly; and a first display included in the headmountassembly and mounted at an angle relative of a user's eye position. Anexemplary system, in accordance with some embodiments, includes adisplay housing; and a first display mounted in said display housing atan angle relative to a viewing surface through which the first displaycan be viewed. An exemplary method of processing and displaying imageson a display, in accordance with various embodiments, includes:receiving a left eye image; receiving a right eye image; transformingthe left eye image as a function of a left eye image display areadisplay arranged at an angle relative to a user's left eye to generate atransformed left eye image, said transforming including scaling the lefteye image as a function of the left eye image display area; transformingthe right eye image as a function of a right eye image display areaarranged at an angle relative to the user's right eye to generate atransformed right eye image, said transforming the right eye imageincluding scaling the right eye image as a function of a right eye imagedisplay area; and displaying the transformed left eye image on the lefteye image display area and displaying the transformed right eye image onthe right eye image display area.

While various features and methods have been described all embodimentsneed not include all features or steps mentioned in the summary.Numerous additional features and embodiments are discussed in thedetailed description which follows.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 illustrates an exemplary system implemented in accordance withsome embodiments of the invention which can be used to capture andstream content for subsequent display by one or more users along withone or more synthesized portions of an environment.

FIG. 2 illustrates an exemplary rendering and playback system, e.g., 3Drendering and playback system, implemented in accordance with oneexemplary embodiment of the invention.

FIG. 3 illustrates another exemplary rendering and playback systemimplemented in accordance with some other embodiments of the invention.

FIG. 4 shows a head mount with displays that are mounted in a normalmanner so that they will be viewed by a user's eyes straight on.

FIG. 5 illustrates a headmounted display system in accordance with anexemplary embodiment of the invention including left and right eyedisplays mounted at angles so that they will not be viewed straight onbut at an angle allowing for a higher perceived resolution than the FIG.4 system since more displayed pixels will be observed per unit area ofeye surface than will be viewed by the eyes in FIG. 4; the displays inFIG. 5 may be and sometimes are larger, e.g., longer and/or taller thanthose shown in FIG. 4.

FIG. 6 illustrates another exemplary headmounted display system inaccordance with an exemplary embodiment of the invention including leftand right eye displays mounted at angles so that they will not be viewedstraight on but at an angle allowing for a higher perceived resolutionthan the FIG. 4 system since more displayed pixels will be observed perunit area of eye surface than will be viewed by the eyes in FIG. 4.

FIG. 7 illustrates an exemplary headmounted display system in accordancewith an exemplary embodiment of the invention including left and righteye tilted displays, which are tiled at an angle allowing for a higherperceived resolution than the FIG. 4 system since more displayed pixelswill be observed per unit area of eye surface than will be viewed by theeyes in FIG. 4.

FIG. 8 illustrates an exemplary headmounted display system in accordancewith an exemplary embodiment of the invention including left and righteye display portions mounted at angles so that they will not be viewedstraight on but at an angle allowing for a higher perceived resolutionthan the FIG. 4 system since more displayed pixels will be observed perunit area of eye surface than will be viewed by the eyes in FIG. 4.

FIG. 9 illustrates an exemplary headmounted display system in accordancewith an exemplary embodiment of the invention including left and righteye tilted display portions, which are tiled at angles allowing for ahigher perceived resolution than the FIG. 4 system since more displayedpixels will be observed per unit area of eye surface than will be viewedby the eyes in FIG. 4.

FIG. 10 is a right side view of the exemplary headmounted display systemof FIG. 9, which illustrates upper and lower display portions of theright eye display.

FIG. 11 illustrates an exemplary content delivery system that can beused to encode and stream content in accordance with the features of theinvention.

FIG. 12 illustrates an exemplary rendering and playback system, inaccordance with exemplary embodiments of the invention, that can be usedto receive, decode, transform, and display the content streamed by thesystem of FIG. 11.

FIG. 13 is a drawing of an exemplary headmounted display system inaccordance with an exemplary embodiment of the invention including atitled slot into which a device, e.g., a smartphone, including a displayis inserted.

FIG. 14 is a drawing of an exemplary headmounted display system inaccordance with an exemplary embodiment of the invention including afixed tilted display in which a first portion of the display is used forviewing left eye images and a second portion of the display is used forviewing right eye images.

FIG. 15 is a drawing of an exemplary headmounted display system inaccordance with an exemplary embodiment of the invention including twoseparate fixed tilted displays in which a first fixed tilted display isused for viewing left eye images and a second fixed tilted display isused for viewing right eye images.

FIG. 16 is a drawing of an exemplary device, e.g., ATM, Kisok, ordashboard, including a tilted display in accordance with an exemplaryembodiment of the invention.

FIG. 17 is a drawing illustrating an available viewing window area, adisplay screen intended to be mounted without tilt, and exemplarydisplay screen portions for an example in which the viewer views thescreen straight on, e.g., as in FIG. 4.

FIG. 18 is a drawing illustrating an available viewing window area, anexemplary display screen which is larger than the viewing window area,the display to be mounted with tilt about a horizontal axis inaccordance with an exemplary embodiment of the invention, e.g., as inFIG. 7, 13, 14, 15, or 16.

FIG. 19 is a drawing illustrating an available viewing window area, anexemplary display screen which is larger than the viewing window area,the display to be mounted with a rotation about a vertical axis inaccordance with an exemplary embodiment of the invention, e.g., as inFIG. 5 or FIG. 6.

FIG. 20A is a first part of a flowchart of an exemplary method ofprocessing and displaying images on one or more displays in accordancewith an exemplary embodiment of the invention.

FIG. 20B is a second part of a flowchart of an exemplary method ofprocessing and displaying images on one or more displays in accordancewith an exemplary embodiment of the invention.

FIG. 20 comprises the combination of FIG. 20A and FIG. 20B.

FIG. 21A is a first part of an assembly of components which may beincluded in an exemplary rendering and playback system in accordancewith an exemplary embodiment of the invention.

FIG. 21B is a second part of an assembly of components which may beincluded in an exemplary rendering and playback system in accordancewith an exemplary embodiment of the invention.

FIG. 21 comprises the combination of FIG. 21A and FIG. 21B.

FIG. 22 is a drawing of exemplary data/information which may be includedin an exemplary rendering and playback system in accordance with anexemplary embodiment of the invention.

DETAILED DESCRIPTION

FIG. 1 illustrates an exemplary system 100 implemented in accordancewith some embodiments of the invention. The system 100 supports contentdelivery, e.g., imaging content delivery, to one or more customerdevices, e.g., 3D capable playback devices located at customer premises.The system 100 includes the exemplary image capturing system 102, acontent delivery system 104, a communications network 105, and aplurality of customer premises (customer premises 1 106, . . . ,customers premises N 110). The image capturing system 102 supportscapturing of stereoscopic imagery, e.g., using stereoscopic camerapairs, as well as capturing of normal non-stereoscopic imagery. Theimage capturing system 102 captures and processes imaging content inaccordance with the features of the invention and may include aplurality of cameras/stereoscopic camera pairs corresponding todifferent camera positions in an environment for capturing images. Thecommunications network 105 may be, e.g., a hybrid fiber-coaxial (HFC)network, satellite network, and/or internet.

The content delivery system 104 includes an encoding apparatus 112 and acontent delivery device/server 114, e.g., a content delivery server,e.g., a content delivery streaming server. The encoding apparatus 112may, and in some embodiments does, include one or a plurality ofencoders for encoding image data. The encoders may be used in parallelto encode different portions of a scene and/or to encode a given portionof a scene to generate encoded versions which have different data rates.Using multiple encoders in parallel can be particularly useful when realtime or near real time streaming is to be supported. In some embodimentsmultiple different encoders are used in parallel to encode streamscaptured by different camera devices placed at different camerapositions to capture images to allow the streaming device 114 to streamcontent corresponding to different camera positions based in a userselection.

The content streaming device 114 is configured to stream, e.g.,transmit, encoded content for delivering the encoded image content toone or more customer devices, e.g., over the communications network 105.Via the network 105, the content delivery system 104 can send and/orexchange information with the devices located at the customer premises106, 110 as indicated in FIG. 1 by the link 120 traversing thecommunications network 105. While the encoding apparatus 112 and contentdelivery server 114 are shown as separate physical devices in the FIG. 1example, in some embodiments they are implemented as a single devicewhich encodes and streams content. The encoding process may be a 3D,e.g., stereoscopic, image encoding process where informationcorresponding to left and right eye views of a scene portion are encodedand included in the encoded image data so that 3D image viewing can besupported. The particular encoding method used is not critical to thepresent application and a wide range of encoders may be used as or toimplement the encoding apparatus 112.

Each customer premises 106, 110 may include one or more devices/systems,e.g., devices capable of decoding, rendering, playback, imagetransforming, and display of the imaging content streamed by the contentstreaming device 114. Customer premises 1 106 includes a 3D renderingand playback system 122 while customer premise N 110 includes 3Drendering and playback system 124. In some embodiments the 3D renderingand playback systems 122, 124 are capable of rendering and displaying 3Dimaging content in accordance with the invention.

In various embodiments the 3D rendering and playback systems 122, 124may decode the imaging content received from the content delivery system104, generate imaging content using the decoded content, and render theimaging content, e.g., 3D image content, on a display e.g., astereoscopic display. In various embodiments the 3D rendering andplayback systems 122, 124 are capable of performing additionalprocessing, e.g., tracking user's head position and/or line of sight todetermine which camera position the user wants to view the environmentfrom and accordingly switch to displaying in accordance with thefeatures of the invention. In various embodiments the 3D rendering andplayback systems 122, 124 are capable of performing additionalprocessing on received images, e.g., transforming a left eye image as afunction of an left image display area arranged at an angle relative toa user's left eye and transforming a right eye image as a function of anright image display area arranged at an angle relative to a user's righteye, in accordance with the features of the invention.

FIG. 2 illustrates an exemplary 3D rendering and playback system 200,implemented in accordance with one exemplary embodiment of theinvention. The exemplary 3D rendering and playback system 200 may beused to display content captured by one or multiple cameras of theimaging system 102 and streamed by the content delivery system 104 to auser, e.g., a customer corresponding to customer premises 106, 110, inaccordance with one exemplary embodiment. The exemplary 3D rendering andplayback system 200 may be used as any of the 3D rendering and playbacksystems (122, . . . , 124) shown in FIG. 1. FIG. 2 shows a rear view ofthe 3D rendering and playback system 200 from the perspective of a useras if the user is going to wear, e.g., head mount, the rendering andplayback system 200. Thus the illustrated view in FIG. 2 shows at leastsome elements that may be visible from the rear, e.g., looking into therendering system 200 from the rear. The exemplary 3D rendering andplayback system 200 includes a headmount assembly 202, a user inputinterface 206, a pair of lenses 210, 212, a tilted and/or rotated leftdisplay 213, a tilted and/or rotated right display 215, and a head strap208. In FIG. 2, left display 213 is visible through left eye lens 210,and the right display 215 is visible through right eye lens 212. In someembodiments, system 200 includes a smartphone insert slot; a smartphoneis inserted into the smartphone insert slot, and the smartphone'sdisplay is used in place of left display 213 and right display 215. Insome embodiments, device 200 includes a single permanently mountedangled, e.g., tilted and/or rotated, display in place of left display213 and right display 215, e.g., with different portions of the singleangled display corresponding to the left display 213 and right display215. The head mounted display assembly 202 includes a display housing203 in which one or more displays, e.g., display 213 and display 215 aremounted in an angled positions, e.g., tilted and/or rotated. Displayhousing 203 has a left side 250 and a right side 252.

Displays may be mounted in the manner shown in FIG. 4, with displays(413, 415) being mounted perpendicular to axis (414, 416), respectively.In FIG. 4, the left eye display 413 is mounted perpendicular to the leftside 450 of the display housing 403; and the right eye display 415 ismounted perpendicular to the right side 452 of the display housing 403.Lens 410 is positioned between left eye display 413 and left eyeposition 407. Lens 412 is positioned between right eye display 415 andright eye position 409. The display mounting shown in FIG. 4 is aconventional display mounting. FIG. 4 shows a head mount with displays(413, 415) that are mounted in a normal manner so that they will beviewed by a user's eyes straight on.

The system 200″, implemented in accordance with an exemplary embodimentof the present invention, shown in FIG. 5 is an embodiment of the system200 shown in FIG. 2 which uses displays (left display 513, right display515) mounted in the housing 503 at angles, e.g. predetermined angleswhich are not 90 degrees with respect to an axis (514, 516),respectively, so that the user will see the displays (513, 515) at anangle rather than straight on. In FIG. 5, the left eye display 513 ismounted at a non 90 degree angle with respect to the left side 550 ofthe display housing 503; and the right eye display 515 is mounted at anon 90 degree angle with respect to the right side 552 of the displayhousing 503.

The system 200 can act as a rendering and playback device, e.g.,performing processing, rendering, playback, transformations, and variousoperations for the system 200. When mounted on a user's head by a user,the user can view a displayed scene, e.g., a simulated 3D environmentincluding content corresponding to a scene, through the lenses 210, 212.The simulated 3D environment displayed to the user allows for a reallife 3D experience as if the user is actually present in the simulatedenvironment.

Via the user input interface 206 user input is detected and actions aretaken by the rendering and playback system 200. For example in someembodiments a user input via the interface 206 may indicate selection ofa camera position selected by the user for viewing content in accordancewith the features of the invention. In some embodiments the user inputinterface 206 includes a touchpad over which the user can move hisfingers and a corresponding pointer, visible to the user on the displayscreen, moves along allowing the user to interact with objects displayedon the screen. In such embodiments the user may control the pointer tointeract, e.g., select, move, delete etc., with icons and/or objectsdisplayed on the screen. For example in some embodiments via theinterface 206 the user may drag a pointer to a highlighted cameraposition of user's choosing and select the camera position, e.g., bytapping on the touchpad of interface 206, for viewing contentcorresponding to the selected camera position.

FIG. 3 illustrates another rendering and playback system 300,implemented in accordance with some embodiments of the invention. Therendering and playback system 300 may be used as any of the exemplary 3Drendering and playback systems (122, . . . , 124) shown in FIG. 1. Therendering and playback system 300 may be used to implement the methodsof the present invention and present content to a user from theperspective of a user desired camera position. The exemplary 3Drendering and playback system 300 includes a playback and renderingdevice 302, e.g., a gaming console such as PS3, PS4 or other playstation version, an Xbox version etc. In addition the rendering andplayback system 300 further includes a display 304 including one or moreangled, e.g., tilted and/or rotated, display screens or display screenportions, and optionally a handheld controller 306. The elements 302,304 and 306 of the system 300 may be wired and/or wirelessly connected(e.g., dashed lines indicating wired and/or wirelessly links). Thedisplay 304 in some embodiments is a head mounted stereoscopic displayincluding one or more angled, e.g. tilted and/or rotated, displayscreens, while in some other embodiments the display 304 may be anotherdisplay device including one or more angled, e.g., tilted and/or rotateddisplay screens, capable of displaying stereoscopic imaging content. Insome embodiments the head mounted stereoscopic display 304 includes oneor more sensors configured to track a user's head movement and/or detecta change in a user's head position. In some embodiments the playback andrendering device 302 includes one or more sensors, e.g., cameras, trackuser's head movement and/or detect a change in user's head position.

FIG. 4 shows display screens (413, 415) mounted so that the user viewsthe screens (413, 415) straight on. Drawing 400 of FIG. 4 illustrates auser's head 405 including a left eye 407 and a right eye 409, andfurther includes 3D rendering and playback system 499. Consider that theuser is wearing headmount assembly 402 with headstrap 408 around theuser's head 405 and the display housing 403 being against the front ofthe user's face, and there is a user left eye position 407, and a userright eye position 409. In the embodiment shown in FIG. 4, the displays(413, 415) are arranged perpendicular to the user's view. Axis 414extends from the left eye 407 to the viewing surface of left display413, and there is an angle of 90 degrees between axis 414 and theviewing surface of the left display 413. Axis 416 extends from the righteye 409 to the viewing surface of right display 415, and there is anangle of 90 degrees between axis 416 and the viewing surface of theright display 415. In the FIG. 4 embodiment, the display screens (413,415) are mounted parallel to line 401 which extends through the user'seyes.

FIG. 5 shows display screens (513, 515) mounted in a housing 503 inaccordance with one exemplary embodiment of the invention so the usersees the screens (513, 515) at an angle and thus will perceive a higherresolution than will be perceived in the system shown in FIG. 4. Drawing500 of FIG. 5 illustrates a user's head 405 including a left eye 407 anda right eye 409, and further includes exemplary 3D rendering andplayback system 200″ in accordance with one exemplary embodiment. Lens510 is positioned between left eye display 513 and left eye position407. Lens 512 is positioned between right eye display 515 and right eyeposition 409. Consider that the user's head 405 is in head mountassembly 502 with headsstrap 508 around the user's head and with thefront of the user's face against the display housing 503, and there is auser left eye position 407, and a user right eye position 409. Lens 510is positioned between left eye display 513 and left eye position 407.Lens 512 is positioned between right eye display 515 and right eyeposition 409. In the embodiment shown in FIG. 5, the displays (513, 515)are arranged angled with respect to the user's view. Axis 514 extendsfrom the left eye 407 to the viewing surface of left display 513, andthere is an angle between axis 514 and the viewing surface of the leftdisplay 513, wherein the angle is a value which is not 90 degrees, e.g.,the angle is a predetermined value greater than 90 degrees. Axis 516extends from the right eye 409 to the viewing surface of right display515, and there is an angle between axis 516 and the viewing surface ofthe right display 516, wherein angle is a value which is not 90 degrees,e.g., the angle is a predetermined value greater than 90 degrees. In oneexemplary embodiment the angle for the left side is the same as has theangle for the right side. In one exemplary embodiment the same value isa predetermined value in the range of 95 degrees to 135 degrees. Inanother exemplary embodiment the same value is a predetermined value inthe range of 45 to 85 degrees. In the FIG. 5 embodiment, the displayscreens (513, 515) are not mounted parallel to line 501, e.g., aremounted in angled positions with respect to line 501, which extendsthrough the user's eyes. In the FIG. 5 embodiment, the left eye display513 is mounted at a non 90 degree angle with respect to the left side550 of the display housing 503; and the right eye display 515 is mountedat a non 90 degree angle with respect to the right side 552 of thedisplay housing 503.

FIG. 6 shows display screens (613, 615) mounted in a housing 603 inaccordance with one exemplary embodiment of the invention so the usersees the screens (613, 615) at an angle and thus will perceive a higherresolution than will be perceived in the system shown in FIG. 4. Drawing600 of FIG. 6 illustrates a user's head 405 including a left eye 407 anda right eye 409, and further includes exemplary 3D rendering andplayback system 200′″ in accordance with one exemplary embodiment.Consider that the user's head 405 is in head mount assembly 602 withheadstrap 608 around the user's head 405 and with the front of theuser's face against the display housing 603, and there is a user lefteye position 407, and a user right eye position 409. Lens 610 ispositioned between left eye display 613 and left eye position 407. Lens612 is positioned between right eye display 615 and right eye position409. In the embodiment shown in FIG. 6, the displays (613, 615) arearranged angled with respect to the user's view. Axis 614 extends fromthe left eye 407 to the viewing surface of left display 613, and thereis an angle between axis 614 and the viewing surface of the left display613, wherein the angle is a value which is not 90 degrees, e.g., theangle is a predetermined value greater than 90 degrees. Axis 616 extendsfrom the right eye 409 to the viewing surface of right display 615, andthere is an angle between axis 616 and the viewing surface of the rightdisplay 615, wherein angle is a value which is not 90 degrees, e.g., theangle is a predetermined value greater than 90 degrees. In one exemplaryembodiment the angle for the left side is the same as has the angle forthe right side. In one exemplary embodiment the same value is apredetermined value in the range of 95 degrees to 135 degrees. Inanother exemplary embodiment the same value is a predetermined value inthe range of 45 to 85 degrees. In the FIG. 6 embodiment, the displayscreens (613, 615) are not mounted parallel to line 601, e.g., aremounted in angled positions with respect to line 601, which extendsthrough the user's eyes. In the FIG. 6 embodiment, the left eye display613 is mounted at a non 90 degree angle with respect to the left side650 of the display housing 603; and the right eye display 615 is mountedat a non 90 degree angle with respect to the right side 652 of thedisplay housing 503.

Left and right of the display screens ((513, 515), (613, 615)) are darkmasks to avoid reflections of light, e.g., light which is not directedtowards a user's eyes (407, 409) due to the display screens ((513, 515),(613, 615)) being mounted at an angle. Note that in FIGS. 4, 5, and 6the boxes are used to represent pixels of a display. In FIG. 4, box 451represents a pixel of left display 413 and box 453 represents a pixel ofright display 415. In FIG. 5, box 551 represents a pixel of left display513 and box 553 represents a pixel of right display 515. In FIG. 6, box651 represents a pixel of left display 613 and box 653 represents apixel of right display 615. More pixels will be observed in the FIG. 5arrangement than in the FIG. 4 arrangement. This is due to the use oflarger screens (513, 515) in the FIG. 5 embodiment and the mountingconfiguration of FIG. 5 where the screen (513, 515) are mounted at anangle to the user's eyes (407, 409) rather than parallel to the user'sface and eyes. Thus while the display screens (413, 415) of FIG. 4 andthe display screens (513, 515) of FIG. 5 may each have the same dotpitch and pixels per square inch of the display, the user will perceivethe displays (513, 515) of FIG. 5 as being of higher resolution than thedisplays (413, 415) of FIG. 4 since the eyes (407, 409) will see morepixels. That is for each square inch of eye area a user will see morepixels in the FIG. 5 embodiment than in the FIG. 4 embodiment because ofthe screen arrangement.

Similarly, more pixels will be observed in the FIG. 6 arrangement thanin the FIG. 4 arrangement. This is due to the use of larger screens(613, 615) in the FIG. 6 embodiment and the mounting configuration ofFIG. 6 where the screen (613, 615) are mounted at an angle to the user'seyes (407, 409) rather than parallel to the user's face and eyes. Thuswhile the display screens (413, 415) of FIG. 4 and the display screens(613, 615) of FIG. 6 may each have the same dot pitch and pixels persquare inch of the display, the user will perceive the displays (613,615) of FIG. 6 as being of higher resolution than the displays (413,415) of FIG. 4 since the eyes (407, 409) will see more pixels. That isfor each square inch of eye area a user will see more pixels in the FIG.6 embodiment than in the FIG. 4 embodiment because of the screenarrangement.

FIG. 7 illustrates an exemplary headmounted display system, inaccordance with an exemplary embodiment of the invention, including leftand right eye tilted displays (713, 715), which are tiled at an angleallowing for a higher perceived resolution than the FIG. 4 system sincemore displayed pixels will be observed per unit area of eye surface thanwill be viewed by the eyes in FIG. 4. Drawing 700 of FIG. 7 illustratesa user's head 405 including a left eye 407 and a right eye 409, andfurther includes exemplary 3D rendering and playback system 200″″ inaccordance with one exemplary embodiment. Consider that the user's head405 is in head mount assembly 702 with headstrap 708 around the user'shead and with the front of the user's face against the display housing703, and there is a user left eye position 407, and a user right eyeposition 409. Lens 710 is positioned between left eye display 713 andleft eye position 407. Lens 712 is positioned between right eye display715 and right eye position 409. In the embodiment shown in FIG. 7, thedisplays (713, 715) are arranged angled with respect to the user's view.Axis 714 extends from the left eye 407 to the viewing surface of leftdisplay 713, and there is an angle between axis 714 and the viewingsurface of the left display 713, wherein angle is a value which is not90 degrees, e.g., the angle is a predetermined value greater than 90degrees. Axis 716 extends from the right eye 409 to the viewing surfaceof right display 715, and there is an angle between axis 716 and theviewing surface of the right display 715, wherein angle is a value whichis not 90 degrees, e.g., the angle is a predetermined value greater than90 degrees. In one exemplary embodiment the angle for the left side isthe same as has the angle for the right side, and the displays (713,715) are mounted in a predetermined rotated position about axis 701 suchthat the user is viewing tilted screens. In one exemplary embodiment thesame value is a predetermined value in the range of 95 degrees to 135degrees. In another exemplary embodiment the same value is apredetermined value in the range of 45 to 85 degrees. In someembodiments, a reference angle about axis 701 is 0 degrees forvertically mounted displays, and for the embodiment of FIG. 7, the tiltangle measured about axis 701 with respect to the reference angle is apredetermined value in one or the ranges of: i) +5 degrees to +45degrees or ii) −5 degrees to −45 degrees.

FIG. 8 illustrates an exemplary headmounted display system, inaccordance with an embodiment of the present invention, including leftand right eye display portions ((813, 814), (815, 816)) mounted atangles so that they will not be viewed straight on but at an angleallowing for a higher perceived resolution than the FIG. 4 system sincemore displayed pixels will be observed per unit area of eye surface thanwill be viewed by the eyes in FIG. 4. The exemplary embodiment of FIG. 8is similar to the FIG. 6 embodiment; however, the FIG. 8 embodiment usestwo differently angled portions (813, 814) for the left eye display andtwo differently angled portions (815, 816) for the right eye display.

FIG. 8 shows left eye display screen portions (813, 814) and right eyedisplay screen portions (815, 816) mounted in a housing 803 inaccordance with one exemplary embodiment of the invention so the usersees the screen portions (813, 814, 815, 816) at an angle and thus willperceive a higher resolution than will be perceived in the system shownin FIG. 4. Drawing 800 of FIG. 8 illustrates a user's head 405 includinga left eye 407 and a right eye 409, and further includes exemplary 3Drendering and playback system 200′″″ in accordance with one exemplaryembodiment. Consider that the user's head 405 is in head mount assembly802 with headstrap 808 around the user's head 405 and with the front ofthe user's face against the display housing 803, and there is a userleft eye position 407, and a user right eye position 409. Lens 810 ispositioned between left eye display 830, comprising the combination ofdisplay portions (813, 814), and left eye position 407. Lens 812 ispositioned between right eye display 831, comprising the combination ofdisplay portions (815, 816), and right eye position 409. In theembodiment shown in FIG. 8, the display portions (813, 814, 815, 817)are arranged angled with respect to the user's view. Axis 824 extendsfrom the left eye 407 to the interface between the viewing surface oftwo left display portions 813, 815 and there is an angle (817, 819)between axis 824 and each of the viewing surfaces of the left displayportions (813, 814) wherein the angle is a value which is not 90degrees, e.g., the angle is a predetermined value less than 90 degrees.Axis 826 extends from the right eye 409 to the interface between theviewing surfaces of right display portions (815, 816) and there is anangle (821, 823) between axis 826 and the each of the viewing surfacesof the right display portions (815, 816) wherein angle is a value whichis not 90 degrees, e.g., the angle is a predetermined value less than 90degrees. In one exemplary embodiment the angle for the left sideportions is the same as the angle for the right side portions. In someexemplary embodiments the same value is a predetermined value in therange of 45 to 85 degrees. In some exemplary embodiments the same valueis a predetermined value in the range of 95 degrees to 135 degrees. Inthe FIG. 8 embodiment, the display screen portions ((813, 814), (815,816)) are not mounted parallel to line 801, e.g., are mounted in angledpositions with respect to line 801, which extends through the user'seyes. In the FIG. 8 embodiment, the display screen portions ((813, 814),(815, 816)) are not mounted perpendicular to the sides (852, 842), e.g.,display screen portions ((813, 814), (815, 816)) are mounted in angledpositions with respect to housing sides (850, 852).

FIG. 9 illustrates an exemplary headmounted display system in accordancewith an exemplary embodiment of the invention including left and righteye tilted display portions ((913, 915), (914, 916)), which are eachtiled at an angle allowing for a higher perceived resolution than theFIG. 4 system since more displayed pixels will be observed per unit areaof eye surface than will be viewed by the eyes in FIG. 4. The exemplaryembodiment of FIG. 9 is similar to the FIG. 7 embodiment; however, theFIG. 9 embodiment uses two differently angled portions (913, 914) forthe left eye display and two differently angled portions (915, 916) forthe right eye display.

Drawing 900 of FIG. 9 illustrates a user's head 405 including a left eye407 and a right eye 409, and further includes exemplary 3D rendering andplayback system 200″″″ in accordance with one exemplary embodiment.Consider that the user's head 405 is in head mount assembly 902 withheadstrap 908 around the user's head and with the front of the user'sface against the display housing 903, and there is a user left eyeposition 407, and a user right eye position 409. Lens 910 is positionedbetween left eye display 930, comprising the combination of displayportions (913, 914), and left eye position 407. Lens 912 is positionedbetween right eye display 931, comprising the combination of displayportions (915, 916), and right eye position 409. In the embodiment shownin FIG. 9, the display portions ((left upper display portion 913, leftlower display potion 914), (right upper display portion 915, right lowerdisplay portion 916)) are arranged angled with respect to the user'sview. Axis 924 extends from the left eye 407 to the interface of viewingsurfaces of tilted left display portions (913, 915) and there is anangle between axis 914 and the viewing surface of each of the leftdisplay portions (913, 914) wherein angle is a value which is not 90degrees, e.g., the angle is a predetermined value less than 90 degrees.Axis 916 extends from the right eye 409 to the interface of the viewingsurfaces of the tilted right display portions (915, 916), and there isan angle between axis 916 and the viewing surface of each of the rightdisplay portions (915, 916), wherein angle is a value which is not 90degrees, e.g., the angle is a predetermined value less than 90 degrees.In one exemplary embodiment the angle for each of the left side portionsis the same as has the angle for each of the right side portions, andthe display portions (913, 914, 915, 916) are each mounted in a rotatedposition about axis 901 such that the user is viewing tilted screenportions. In another exemplary embodiment the same value is apredetermined value in the range of 45 to 85 degrees. In one exemplaryembodiment the same value is a predetermined value in the range of 95degrees to 135 degrees.

FIG. 10 is a drawing 1000 illustrating a right side view of theexemplary headmounted display system of FIG. 9, which illustrates upperand lower display portions (915, 916) of the right eye display 931 andfurther illustrates an angle 921 between the upper right display portion915 and axis 926, and an angle 923 between the lower right displayportion 916 and axis 926.

FIG. 13 includes a drawing 1300 including a right side view of anexemplary headmounted display system 1302 in accordance with anexemplary embodiment of the invention including a titled slot 1350 intowhich a device 1352, e.g., a smartphone, including a display 1313 isinserted, and a drawing 1350 including a left side view of the exemplaryheadmounted display system 1302 including the titled slot 1350 intowhich a device 1352, e.g., a smartphone, including a display 1313 isinserted. The headmounted display system 1302 includes display housing1303 including right eye lens 1312, left eye lens 1310, tilted slot1350, and inserted device 1352 including display 1313. Headmounteddisplay system 1302 further includes headstrap 1308 which goes aroundthe user's head 405 to secure the display housing 1303 against the frontof the user's face. There is a non 90 degree angle 1356 between an axisextending straight ahead forward from the user's right eye 409 to thedisplay surface. There is a non 90 degree angle 1356 between an axisextending straight ahead forward from the user the user's left eye 407to the display's viewing surface. In this exemplary embodimentsdifferent non-overlapping portions of screen 1313 are used to displaythe left and right images, e.g., of a transformed stereoscopic imagepair. FIG. 13 illustrates an exemplary headmounted display system 1302including a tilted display 1313, which is tiled at an angle allowing fora higher perceived resolution than the FIG. 4 system since moredisplayed pixels will be observed per unit area of eye surface than willbe viewed by the eyes in FIG. 4.

FIG. 14 includes a drawing 1400 including a right side view of anexemplary headmounted display system 1402 in accordance with anexemplary embodiment of the invention including a fixed tilted display1413 in which a first portion of the display 1413 is used for viewingleft eye images and a second portion of the display 1413 is used forviewing right eye images; and a drawing 1450 including a left side viewof the exemplary headmounted display system 1402 including fixed tilteddisplay 1413 in which a first portion of the display is used for viewingleft eye images and a second portion of the display is used for viewingright eye images. The headmounted display system 1402 includes displayhousing 1403 including right eye lens 1412, left eye lens 1410 andtilted display 1413. Headmounted display system 1402 further includesheadstrap 1408 which goes around the user's head 405 to secure thedisplay housing 1403 against the front of the user's face. There is anon 90 degree angle 1456 between an axis extending straight aheadforward from the user the user's right eye 409 to the display surface.There is a non 90 degree angle 1456 between an axis extending straightahead forward from the user the user's left eye 407 to the display'sviewing surface. In this exemplary embodiments different non-overlappingportions of screen 1413 are used to display the left and right images,e.g., of a transformed stereoscopic image pair. FIG. 14 illustrates anexemplary headmounted display system including a tilted display 1413,which is tiled at an angle allowing for a higher perceived resolutionthan the FIG. 4 system since more displayed pixels will be observed perunit area of eye surface than will be viewed by the eyes in FIG. 4.

FIG. 15 includes drawings of an exemplary headmounted display system1502 including two separate fixed tilted displays (1513, 1515) in whicha first fixed tilted display 1513 is used for viewing left eye imagesand a second fixed tilted display 1515 is used for viewing right eyeimages. FIG. 15 includes a drawing 1500 including a right side view ofan exemplary headmounted display system 1502 and a drawing 1550including a left side view of the exemplary headmounted display system1502. The headmounted display system 1502 includes display housing 1503including right eye lens 1512, left eye lens 1510, and right side tilteddisplay 1515 and left side tilted display 1513. Headmounted displaysystem 1502 further includes headstrap 1508 which goes around the user'shead 405 to secure the display housing 1503 against the front of theuser's face. There is a non 90 degree angle 1556 between an axisextending straight ahead forward from the user the user's right eye 409to the surface of the right tilted display 1515. There is a non 90degree angle 1557 between an axis extending straight ahead forward fromthe user the user's left eye 407 to the viewing surface of the lefttilted display 1513. In some embodiments, angle 1556 is the same asangle 1557. In one exemplary embodiment angle 1556=angle 1557, which isa predetermined value in the range of 95 degree to 135 degrees. Inanother exemplary embodiment angle 1556=angle 1557, which is apredetermined value in the range of 85 degree to 45 degrees. FIG. 15illustrates an exemplary headmounted display system 1502 includingtilted displays (1515, 1513), which are tilted at angles allowing for ahigher perceived resolution than the FIG. 4 system since more displayedpixels will be observed per unit area of eye surface than will be viewedby the eyes in FIG. 4.

FIG. 16 includes drawings (1602, 1650) including an exemplary system1602 including an exemplary device 1601, e.g., ATM, Kisok, or dashboard,including a tilted display 1613 in accordance with an exemplaryembodiment. Device 1601 includes a display housing 1603, including aviewing window 1610, e.g., a viewing surface through which display 1613can be viewed, and a tilted display 1613, which is tilted at a non 90degree angle 1666 with respect to the straight ahead view from theuser's eyes (407, 409) of the viewer's head 405. In various embodiments,the viewing surface 1610 is a glass or plastic surface through whichdisplay 1610 can be viewed. FIG. 16 illustrates an exemplary device 1601including a tilted display 1613, which is tilted at a non 90 degreeangle allowing for a higher perceived resolution than if a display wasmounted untilted where the angle was 90 degrees, given the same viewingwindow size. In some embodiments, display 1613 is rotated about avertical axis rather than tilted.

FIG. 17 is a drawing 1700 illustrating an available viewing window area1702, an exemplary display screen A 1704 intended to be mounted withouttilt as in FIG. 4. Drawing 1700 further includes drawing 1706illustrating an example in which display screen A 1704 has beensubdivided into portions 1707. Each portion 1707 corresponds to apredetermined number of light emitting elements. In this example display1704 has been subdivided into 100 portions 1707. Four dots are shown ineach of the four display portions of the upper left area 1709 toillustrate an example of four exemplary light emitting elements per unit1707. It should be appreciated that each unit 1707 in screen 1704 hasthe same number of light emitting elements.

FIG. 18 is a drawing 1800 illustrating available viewing window area1702, an exemplary display screen B 1802, which is larger than theviewing window area 1702 and is larger than display screen A 1704, thedisplay B 1802 is intended to be mounted with tilt about a horizontalaxis, e.g., as in FIG. 7, 13, 14, 15, or 16, in accordance with anexemplary embodiment of the present invention. Drawing 1804 showsdisplay screen B divided into portions 1707. Each portion 1707corresponds to a predetermined number of light emitting elements. Inthis example display 1802 has been subdivided into 140 portions 1707.Four dots are shown in each of the four display portions of the upperleft area 1805 to illustrate an example of four exemplary light emittingelements per unit 1707. It should be appreciated that each unit 1707 inscreen 1802 has the same number of light emitting elements.

Drawing 1800 further includes drawing 1806 which illustrates a displayscreen B eye view when mounted with a tilt about a horizontal axis inaccordance with a feature of some embodiments of the present invention,and drawing 1808 which illustrates the subdivided display B 1802 usereye view when mounted with the tilt about the horizontal axis. Four dotsare shown in each of the four display portions of the upper left area1809 to illustrate an example of four exemplary light emitting elementsper unit 1707.

Consider that a received image was mapped to display screen A 1704 anddisplayed to a user by display screen A, which is mounted without tiltor rotation. Consider that the same received image was transformed, e.g.scaled, said scaling altering the aspect ratio, and mapped to largerdisplay screen B 1802, which is intentionally mounted with tilt inaccordance with the present invention, and displayed to a user. Whenviewing 1808 the user will see a higher perceived resolution than whenviewing 1706 since more displayed pixels will be observed per unit areaof eye surface when viewing 1808 than will be viewed by the eyes whenviewing 1706.

FIG. 19 is a drawing 1900 illustrating an available viewing window area1702, an exemplary display screen C 1902 which is larger than theviewing window area A 1702, the display C 1902 to be mounted with arotation about a vertical axis in accordance with an exemplaryembodiment, e.g., as in FIG. 5 or FIG. 6. Drawing 1900 further includesdrawing 1904 which shows display screen C 1902 divided into portions1707. Each portion 1707 corresponds to a predetermined number of lightemitting elements. In this example display 1904 has been subdivided into140 portions 1707. Four dots are shown in each of the four displayportions of the upper left area 1905 to illustrate an example of fourexemplary light emitting elements per unit 1707. It should beappreciated that each unit 1707 in screen 1902 has the same number oflight emitting elements.

Drawing 1900 further includes drawing 1906 which illustrates a displayscreen C eye view when mounted with a rotation about a vertical axis,and drawing 1908 which illustrates the subdivided display C eye viewwhen mounted with the rotation about the vertical axis. Four dots areshown in each of the four display portions of the upper left area 1909to illustrate an example of four exemplary light emitting elements perunit 1707.

Consider that a received image was mapped to display screen A 1704 anddisplayed to a user by display screen A, which is mounted without tiltor rotation. Consider that the same received image was transformed, e.g.scaled, said scaling altering the aspect ratio, and mapped to largerdisplay screen C 1902, which is intentionally mounted with rotationabout a vertical axis in accordance with the present invention, anddisplayed to a user. When viewing 1908 the user will see a higherperceived resolution than when viewing 1706 since more displayed pixelswill be observed per unit area of eye surface when viewing 1908 thanwill be viewed by the eyes when viewing 1706.

It should be appreciated that in some embodiments, there are 2 screen Bdisplays 1802, one being a right eye display and the other being a lefteye display. It should be appreciated that in some embodiments, thereare 2 screen C displays 1902, one being a right eye display and theother being a left eye display.

While the display mounting methods are well suited for use in headmounted display systems, e.g., as shown and described with respect toFIGS. 2, 5, 6, 7, 8, 9, 10, 13, 14 and 15, they are also useable ondevices where the display can be mounted at an angle relative to theuser, e.g., as shown in FIG. 16. For example in ATM machines, notebookcomputers and/or other systems. While the mounting of the display ordisplays at an angle may require more depth than a normal flat mounting,in many applications the thinness of a device is not critical, and theimproved perceived improved quality in the viewed image can merit use ofthe described screen mounting arrangement in a wide variety ofapplications.

FIG. 11 illustrates an exemplary content delivery system that can beused to encode and stream content in accordance with the features of theinvention. The system may be used to perform encoding, storage, andtransmission and/or content output in accordance with the features ofthe invention. The content delivery system 1100 may be used as thesystem 104 of FIG. 1. While the system shown in FIG. 11 is used forencoding, processing and streaming of content, it should be appreciatedthat the system 1100 may also include the ability to decode and displaythe received, processed and/or encoded image data, e.g., to an operator.

The system 1100 includes a display 1102, input device 1104, input/output(I/O) interface 1106, an assembly of hardware components, e.g. anassembly of circuits 1107, a processor 1108, network interface 1110 anda memory 1112. The various components of the system 1100 are coupledtogether via bus 1109 which allows for data to be communicated betweenthe components of the system 1100. The system 1100 in some embodimentsreceives imaging content 1132 captured by the imaging devices at variousdifferent camera positions in the environment via the network interface1110 and/or the I/O interface 1106. In some embodiments the system 1100processes and encodes the received imaging data 1132 prior to deliveringthe content, e.g., over communications network 105, to customerrendering and playback systems such as systems 122, 124. Via the display1102 the system 1100 can display the received, processed and/or encodedimage data, e.g., to an operator. Via the input device 1104, which maybe a keyboard, touch sensitive screen or another such input interface,an operator can provide input to the system 1100, e.g., to provide oneor more input parameters and/or commands. Via the network interface 1110(which includes a receiver 1141 and transmitter 1143) the system 1100communicates (receives and/or transmits information) with externaldevices over the communications network 105. In some embodiments thesystem 1100 delivers encoded imaging content, acquired from one or morecamera devices which captured the imaging content, to customer renderingand playback systems such as systems 122, 124, e.g., over communicationsnetwork105.

The memory 1112 includes various components, e.g., routines, which whenexecuted by the processor 1108 control the computer system 1100 toimplement image, e.g., video, acquisition, encoding, storage, andtransmission and/or output operations in accordance with the invention.The memory 1112 includes control routines 1114, encoder(s) 1118, astreaming controller 1120, received input images 1132, e.g.,stereoscopic or normal video of a scene, encoded image data 1134, andcontent stream(s) information 1136. In some embodiments the componentsare, implemented as software modules. In other embodiments thecomponents are implemented in hardware, e.g., as individual circuitswith each component being implemented as a circuit for performing thefunction to which the component corresponds. In still other embodimentsthe components are implemented using a combination of software andhardware.

The encoder(s) 1118 may, and in some embodiments do, include a pluralityof encoders configured to encode received image content, e.g., a sceneand/or one or more scene portions. In some embodiments encoder(s)include multiple encoders with each encoder being configured to encode ascene and/or partitioned scene portions to support a given bit ratestream. The scene may be a stereoscopic scene. Thus in some embodimentseach scene portion can be encoded using multiple encoders to supportmultiple different bit rate streams for each scene. An output of theencoder(s) 1118 is the encoded image content 1134 which are stored inthe memory for streaming to customer devices, e.g., rendering andplayback devices. The encoded content can be streamed to one or multipledifferent devices via the network interface 1110.

The streaming controller 1120 is configured to control streaming ofencoded content for delivering the encoded image content 1134 to one ormore customer devices, e.g., over the communications network 105. Thestreaming controller 1120 includes a request processing component 1122,a data rate determination component 1124, a user head orientationdetermination component 1126, and a streaming control component 1130.The request processing component 1122 is configured to process areceived request for imaging content from a customer rendering andplayback system. The request for content is received in variousembodiments via a receiver in the network interface 1110. In someembodiments the request for content includes information indicating theidentity of requesting rendering and playback system. In someembodiments the request for content may include data rate supported bythe customer playback device, a current head orientation of the user,e.g., orientation of the head mounted display. The request processingcomponent 1122 processes the received request and provides retrievedinformation to other elements of the streaming controller 1120 to takefurther actions. While the request for content may include data rateinformation and current head position information, in variousembodiments the data rate supported by the playback device can bedetermined from network tests and other network information exchangebetween the system 1100 and the playback and rendering systems. While insome embodiments some customer rendering and playback systems mayrequest content streams based on determined head orientation of the userat the given time, e.g., to allow the user to view the environment fromthe perspective of a desired camera position in the environment, in manycases the customer rendering and playback systems may not specificallyrequest a content stream but rather simply attach to a broadcast contentstream among a plurality of content streams broadcast by the contentdelivery system 1100. In some embodiments the content delivery system1100 broadcasts different content streams corresponding to differentavailable camera positions in an environment in accordance with theinvention. The content delivery system 1100 provides content streaminformation 1136 to the customer rendering and playback systemsproviding information regarding a plurality of content streams that maybe available for receiving and use in playback and indicatinginformation needed to tune to the broadcast content streams. The contentstream information 1136 also indicates which content stream communicatesand corresponds to which camera position in the environment to allow thecustomer rendering and playback systems to select and receive theappropriate content stream. The customer systems may also use the streaminformation 1136 to request a particular content stream corresponding toa user selected camera position at a given time in accordance with theinvention.

The data rate determination component 1124 is configured to determinethe available data rates that can be used to stream imaging content tocustomer devices, e.g., since multiple encoded scene portions aresupported, the content delivery system 1100 can support streamingcontent at multiple data rates to the customer device. The data ratedetermination component 1124 is further configured to determine the datarate supported by a playback device requesting content from system 1100.In some embodiments the data rate determination component 1124 isconfigured to determine available data rate for delivery of imagecontent based on network measurements.

The user head orientation determination component 1126 is configured todetermine a current viewing angle and/or a current head orientation ofthe user, e.g., orientation of the head mounted display, frominformation received from the customer rendering and playback system.The streaming control component 1130 is configured to control streamingof image content at various supported data rates in some embodiments.

FIG. 12 illustrates an exemplary rendering and playback system 1200 thatcan be used to receive, decode and display the content streamed by thecontent streaming system of FIGS. 1 and 11. The exemplary rendering andplayback system 1200 may be used as any of the rendering and playbacksystems shown in FIG. 1-3, 5-10, or 13-16. The rendering and playbacksystem 1200, in some embodiments, includes and/or is coupled to a 3Dhead mounted display. The system 1200 includes the ability to decode thereceived encoded image data and generate 3D image content for display tothe customer. The rendering and playback system 1200 in some embodimentsis located at a customer premise location such as a home or office butmay be located at an image capture site as well. The rendering andplayback system 1200 can perform signal reception, decoding, viewingposition and/or content presentation control, display and/or otheroperations in accordance with the invention.

The exemplary rendering and playback system 1200 can receive, decode,store and display imaging content, e.g., in a simulated environment, toa user of the system 1200. The exemplary rendering and playback system1200 may be used as the rendering and playback systems 122, 124, 200 and300 shown in FIGS. 1-3, 5-10, and 13-16. The system 1200 includes theability to decode received encoded image data, e.g., left and right eyeimages and/or mono (single images) captured by imaging apparatus locatedat various different camera positions in an environment from wherecontent is being captured and generate image content for display to auser in accordance with the features of the invention.

The rendering and playback system 1200 includes a display 1202, e.g., ahead mounted stereoscopic display, input interface 1204, one or morecameras 1205, input/output (I/O) interface 1206, an assembly of hardwarecomponents, e.g. an assembly of circuits 1207, a processor 1208, networkinterface 1210 and a memory 1212. In some embodiments, the rendering andplayback system 1200 includes a second display 1203, e.g., a headmounted stereoscopic display. In some embodiments, a first one of thedisplays, e.g., display 1202, is used to display left eye images, and asecond one of the displays, e.g., display 1204 is used to display lefteye images. In some embodiments, first and second displays 1202, 1203are mounted in a headmounted stereoscopic display assembly. In someembodiments, the display 1202 or displays 1202, 1203 are intentionallymounted in tilted or rotated positions, e.g., so the viewer does notlook directly straight on at the screen or screens. In some embodiments,each of the displays 1202, 1203 includes multiple screen portions, e.g.,as shown in FIGS. 8-10, which are each mounted tilt or rotation angles.The various components of the system 1200 are coupled together via bus1209 which allows for data to be communicated between the components ofthe system 1200 and/or by other connections or through a wirelessinterface. The rendering and playback system 1200 includes the headmounted 3D display 1202, and in some embodiments additional display1203, on which the image content is presented, e.g., with left and righteyes of a user being presented with different images in the case ofstereoscopic content. By displaying different images to the left andright eyes on a single screen, e.g., on different portions of the singlescreen to different eyes, a single display can be used to display leftand right eye images which will be perceived separately by the viewersleft and right eyes. In some embodiments 2 distinct display screens1202, 1203 are used corresponding to different eyes. In some embodimentsthe playback and rendering system 1200 is used as the playback andrendering system 200 and a cell phone/Smartphone screen is used as thedisplay 1202. In some other embodiments the playback and renderingsystem 1200 is used as the playback and rendering system 300. The headmounted display 1202 maybe implemented using the OCULUS RIFT™ VR(virtual reality) headset which may include the head mounted display1202. Other head mounted displays may also be used. In a case where acell phone, e.g., Smartphone, processor is used as the processor 1208and the cell phone generates and displays images in a head mountassembly (such as head mount 102), the system 1200 may include as partof the head mount device the processor 1208, display 1202, camera(s)1205 and memory 1212. The processor 1208, display 1202 and memory 1212may all be part of the cell phone. In other embodiments of the system1200, the processor 1208 may be part of a gaming system such as an XBOX,PS3, PS4 etc., with the display 1202 being mounted in a head mountingdevice and coupled to the gaming system. Whether the processor 1208 ormemory 1212 are located in the device which is worn on the head or notis not critical and, as can be appreciated, while in some cases it maybe convenient to collocate the processor in the headgear, from a power,heat and weight perspective it can be desirable to in at least somecases to have the processor 1208 and memory coupled to the head gearwhich includes the display. While various embodiments contemplate a headmounted display 1202, the methods and system can also be used withnon-head mounted displays which can support 3D image.

The operator/user of the playback and rendering system 1200 may controlone or more parameters, input information, commands etc., via the userinput interface 1204 and/or select operations to be performed, e.g.,select to display simulated environment including scene content. Via theuser input interface 1204 a user provides input to the rendering andplayback system 1200, e.g., input indicating a user selected switch froma first camera position to another camera position. The user inputinterface may include, for example, a keyboard, keypad, touchpad and/ortouch sensitive screen. The user input interface 1204 includes areceiver 1211 via which the rendering and playback system 1200 receivesthe information/data provided by the user. The user may use the userinput interface 1204 to make a selection of item and/or respond to adisplayed prompt and/or other indication requiring user's input. Forexample user can provide input selecting a different camera positionthan a currently selected camera position from which the user is viewingthe environment. The user input may be provided e.g., by a single tap,double tap or some other action on the input interface 1204.

The camera(s) 1205 includes one or more cameras which can be, andsometimes are, used to capture images, e.g., of persons, physicalenvironment and/or objects in the physical environment where the system1200 is located. In some embodiments where the system 1200 is used asthe rendering and playback 200 the camera 1205 may be the camera deviceof the Smartphone being used in the system 200. In some embodimentswhere the system 1200 is used as the rendering and playback system 300the camera 1205 may be the camera located on the rendering device 302 oron the head mounted display 304.

Via the I/O interface 1206, the system 1200 can be coupled to externaldevices to exchange signals and/or information with other devices. Insome embodiments via the I/O interface 1206 the system 1200 can receiveinformation and/or images captured by external cameras and outputinformation and/or images to external devices. The I/O interface 1206includes a receiver (RX) 1221 and a transmitter (TX) 1223 via which thereceiving and transmitting operations are performed. In some embodimentsvia the interface 1206 the system 1200 is coupled to an externalcontroller, e.g., such as the handheld controller 306. In embodimentswhere a handheld controller 306 is available, the handheld controller306 may be coupled to the I/O interface 1206 and used to enterinformation and/or provide user input, e.g., selecting a camera positionfrom which the user would like to experience the environment, to thesystem via the I/O interface 1206.

The processor 1208, e.g., a CPU, executes routines 1214 and uses thevarious components to control the system 1200 to operate in accordancewith the invention. The processor 1208 is responsible for controllingthe overall general operation of the system 1200. In various embodimentsthe processor 1208 is configured to perform functions that have beendiscussed as being performed by the playback and rendering system 1200.

Via the network interface 1220 the system 1200 communicates and/orreceives signals and/or information (e.g., including images and/or videocontent corresponding to a scene) to/from various external devices overa communications network, e.g., such as communications network 105. Thenetwork interface 1220 includes a receiver 1231 and a transmitter 1233via which the receiving and transmitting operations are performed. Insome embodiments the system receives one or more content streams via thenetwork interface 1220 from the content delivery system 104. In someembodiments the system 1200 receives, via the receiver 1231 of interface1220, one or more content streams communicating content captured by oneor more camera devices located at different camera positions in anenvironment to use for playback, e.g., stream communicating contentcorresponding to a scene of an event, e.g., soccer game. The receivedcontent stream may be received as encoded data, e.g., encoded scene data1242.

In some embodiments the memory 1212 includes various routines and/orcomponents which when executed by the processor 1208 control therendering and playback system 1200 to perform operations in accordancewith the invention. The memory 1212 includes control routines 1214, amonitoring component 1216, a head orientation and/or viewing angledetermination component 1218, a decoder 1220, an image renderer 1222, aninitialization controller 1224, a content stream selection component1226, a display controller 1228, a head orientation change detectioncomponent 1230, a determination component 1232, a camera positiondetermination component 1234, a timer 1236, user input determinationcomponent 1238, and a switching controller 1240. The memory 1212 furtherincludes data/information including encoded data 1242, decoded data 1244and generated image content 1246.

The control routines 1214 include device control routines andcommunications routines to control the operation of the system 1200. Themonitoring component 1216 is configured to monitor for user input,commands, instructions provided by the user via, e.g., the user inputinterface 1204 and/or I/O interface 1206. In some embodiments themonitoring component 1216 monitors for user control inputs forcontrolling the rendering and playback system 1200, e.g., controlzooming to a displayed area, controlling volume and/or other features.

The head orientation and/or viewing angle determination component 1218is configured to determine a current head orientation of the user, e.g.,orientation of the head mounted display. The head orientationdetermination component 1218 may be implemented using one or acombination of sensors to detect user's head orientation at a giventime. In some embodiments the determined head orientation and/or changein orientation from a reference orientation is used in determining whichof a plurality of camera position the user is viewing at a given time.

The decoder 1220 is configured to decode encoded image content 1242,e.g., encoded content communicated in a content stream received from acontent delivery system to produce decoded image data 1244. The decodedimage data 1244 may include decoded images captured by imaging deviceslocated at various camera positions in an environment where the imagesare captures. The image renderer 1222 uses decoded image data includingcontent corresponding to a scene to generate content for displaying to auser on the display 1202. The generated imaging content 1246 which isdisplayed to a user is the output of the image renderer 1222. The imagerenderer 1222 may be implemented as a 3D image generation component torender 3D stereoscopic image content.

The initialization component 1224 is configured to set the detectedcurrent head orientation as a default/reference head orientation, e.g.,0 degree head rotation and head tilt angles, during the system operationinitialization phase. The initialization component 1224 is furtherconfigured to initialize a current viewing position by setting thecurrent viewing position to correspond to a first camera position, e.g.,a default camera position (predetermined) or a last used cameraposition. During content display a current viewing position correspondsto a currently selected camera position from where the user willexperience the content in the displayed simulated environment.

The content stream selection component 1226 is configured to select acontent stream communicating content captured by an imaging device atthe selected camera position, e.g., camera position selected by theinitialization component 1224 during initialization and/or selected bythe user. In various embodiments the content stream selection component1226 uses the content stream information 1248 to decide which stream(s)to select for use in display. Depending on a camera position selected ata given time the content stream selection component 1226 selects acorresponding content stream accordingly. The display controller 1228 isconfigured to control displaying of a simulated environment includingcontent corresponding to a user selected camera position in theenvironment to the user on the display device 1202. The displaycontroller 1228 is configured to control presentation, e.g., display, ofcontent corresponding to the selected camera position in theenvironment, e.g., on the head mounted display 1202. Thus duringinitialization the display controller 1228 controls presentation ofcontent corresponding to a first camera position, e.g., default or lastused camera position, e.g., with the user being presented content fromthe perspective of the first camera position which has been chosen asthe default camera position during initialization. At another time thedisplay controller 1228 may control presentation of contentcorresponding to another user selected camera position in theenvironment.

The head orientation change detection component 1230 is configured tomonitor the user's current head orientation to detect changes in thehead orientation, e.g., due to rotation of head, tilting of the head orboth rotation and tilting, from an initial/current head orientation. Insome embodiments the head orientation change detection component 1230monitors for changes in the head orientation following the initialdetection of user's head orientation and setting of thedefault/reference head orientation. The head orientation changedetection component 1230 is configured to detect changes in the headorientation relative to a currently set head orientation at a giventime, e.g., default/reference head orientation initially detected by thehead orientation determination component 1218. Thus if the user's headorientation changes from the initially detected head orientation, e.g.,due to head rotation, tilt or both, the head orientation changedetection component 1230 receives an input from the head orientationdetermination component 1218 indicating a current head orientation andcompares it against the currently set/previously detected headorientation of the user stored in memory 1212 to determine if there hasbeen any changes in the head orientation. In some embodiments the headorientation change detection component 1230 is further configured todetermine the head angle of rotation and/or head tilt angle relative tothe default head orientation, e.g., how much has the user rotated and/ortilted his/her head from the 0° position corresponding to thedefault/reference head orientation or an angle corresponding to thepreviously detected head orientation. In various embodiments such headangle of rotation and/or head tilt angle information is used todetermine if the user has been viewing another camera position in theenvironment.

The determination component 1232 is configured to determine if the useris viewing another camera position in the environment at a given time.In some embodiments the determination component 1232 is configured todetermine if the user is viewing another camera position in theenvironment from i) head angle of rotation, ii) head tilt angle or iii)both the user head angle of rotation and user head tilt angle. Invarious embodiments the determination component 1232 receives theinformation indicating the changes in head orientation, e.g., head angleof rotation and/or head tilt angle from the head orientation changedetection component 1230 and uses this information to make adetermination whether the user is viewing another camera position in theenvironment. In some embodiments the determination component 1232includes the head orientation change detection component 1230. Invarious embodiments when it is determined that the user has been viewingthe another camera position the monitoring component 1216 monitors formonitors, while the user of the system 1200 is viewing the anothercamera position in the environment, to detect user input indicating auser selected switch to the another camera position. In some embodimentsthe monitoring component 1216 monitors for user input on a control inputinterface (e.g., such as the user interface 1204) while the user isviewing the another camera position.

The camera position determination component 1234 is configured todetermine which of a plurality of alternative camera positions the useris viewing based on at least one of the user head angle of rotation orthe head tilt angle. The timer 1236 is configured to determine if theuser has been viewing the another camera position for a predeterminedtime. In some embodiments the timer 1234 monitors the time elapsed sincethe user has been determined to be viewing the other camera position anddetect if the elapsed time equals or exceeds the predetermined time. Invarious embodiments when it is determined that the user has not beenviewing the another camera position or was viewing the another cameraposition for less than the predetermined time, the display controller1228 is configured to control the system to continue displaying, e.g.,on the display 1202, content corresponding to the first camera position.In various embodiments when it is determined that the user has beenviewing the another camera position for the predetermined time, thedisplay controller 1228 is configured to control the system 1200 topresent, e.g., display along with the content being presented, the useran indication that the user can switch to viewing the environment from aperspective of the another camera position. In some embodiments thedisplay controller 1228 is configured, as part of presenting the user anindication that the user can switch to viewing the environment from aperspective of the another camera position, to provide a visualindication corresponding to the another camera position indicating thata switch to viewing the environment from the perspective of the anothercamera position is possible. In some embodiments the visual indicationis one of at least a change in color or shading at said another cameraposition. In some embodiments the visual indication includes text in thearea of said another camera position putting the user on notice of thepotential to switch to viewing from the perspective of said anothercamera position.

The user input determination and processing component 1238 is configuredto determine if the user input indicating a user selected switch to theanother camera position has been detected, e.g., on the user inputinterface 1204 or other interface, within a predetermined time of thestart of presenting the indication to the user, e.g., visual indication.The user input determination and processing component 1238, upondetermining that a user input has been detected at a user interface,processes the user input information and/or commands/instructions andtake action accordingly and/or provide the received input to anothersystem element for further processing, action or storage in the memory1212. In some embodiments when it is determined that the user inputindicating a user selected switch to the another camera position has notbeen detected within the predetermined time from the start of presentingthe indication the user input determination and processing component1238 provides an instruction to the display controller 1228 toeliminate, e.g., exclude from being displayed, the indication that theuser can switch to the another camera position. Accordingly the displaycontroller 1228 controls the system 1200 to eliminate the indicationindicating that the user can switch to the another camera position.

In various embodiments when it is determined that the user inputindicating a user selected switch to the another camera position hasbeen detected within the predetermined time the user input determinationand processing component 1238 provides an instruction to the streamselection component 1226 to select a content stream corresponding to theanother camera position. Thus when it is determined that the user inputindicating a user selected switch to the another camera position hasbeen detected within the predetermined time the stream selectioncomponent 1226 is configured to select a content stream communicatingcontent captured by an imaging device located at the another, e.g.,second, camera position in the environment.

The switching controller 1240 is configured to control the system 1200to switch from displaying to the user content corresponding to the firstcamera position in the environment to displaying content correspondingto the another camera position in the environment when it is determinedthat the user input indicating a user selected switch to the anothercamera position has been detected within the predetermined time. In somesuch embodiments switching controller 1240 is configured to control thesystem to switch from receiving and displaying a first broadcast contentstream corresponding to an output of a first imaging device, e.g., afirst stereoscopic camera pair, located at the first camera position toreceiving and displaying a second broadcast content stream correspondingto an output of a second imaging device, e.g., a second stereoscopiccamera pair, located at said another camera position.

The content stream information 1248 includes information regarding aplurality of content streams that may be available for receiving and usein playback. In some embodiments the stream information 1248 is providedby the content provider's content delivery system 1100 (e.g., streaminformation 1136). In some embodiments the different available contentstreams correspond to different imaging devices located at differentcamera positions in the environment. In some embodiments the streaminformation 1248 includes, for a plurality of available content streams,one of a multicast address of a multicast group which can be joined toreceive a given content stream corresponding to a given camera position,information which can be used to request access to a switched digitalvideo channel used to provide a given content stream corresponding to agiven camera position, or channel tuning information which can be usedto control a tuner of the playback system 1200 to tune to a broadcastchannel on which a given content stream corresponding to a given cameraposition is broadcast.

In some embodiments, the memory 1212 includes an assembly of components1250, e.g., an assembly of software components, and data/information1252.

In some embodiments the components and/or elements shown in the memory1212 are implemented as software modules. In other embodiments theelements, while shown to be included in the memory 1212, are implementedin hardware, e.g., as individual circuits with each element beingimplemented as a circuit for performing the function corresponding tothe element. In still other embodiments the components and/or elementsare implemented using a combination of software and hardware.

While shown in FIG. 12 example to be included in the memory 1212, theelements shown included in the system 1200 can, and in some embodimentsare, implemented fully in hardware within the processor 1208, e.g., asindividual circuits. In other embodiments some of the elements areimplemented, e.g., as circuits, within the processor 1208 with otherelements being implemented, e.g., as circuits, external to and coupledto the processor 1208. As should be appreciated the level of integrationof components on the processor and/or with some components beingexternal to the processor may be one of design choice. Alternatively,rather than being implemented as circuits, all or some of the elementsmay be implemented in software and stored in the memory 1212 of thesystem 1200, with the software components controlling operation of thesystem 1200 to implement the functions corresponding to the componentswhen the components are executed by a processor, e.g., processor 1208.In still other embodiments, various elements are implemented as acombination of hardware and software, e.g., with a circuit external tothe processor 1108 providing input to the processor 1208 which thenunder software control operates to perform a portion of a component'sfunction.

While shown in the FIG. 12 embodiment as a single processor, e.g.,computer, it should be appreciated that the processor 1208 may beimplemented as one or more processors, e.g., computers. When one or moreelements in the memory 1212 are implemented as software components, thecomponents include code, which when executed by the processor 1208,configure the processor 1208 to implement the function corresponding tothe component. In embodiments where the various components shown in FIG.12 are stored in the memory 1212, the memory 1212 is a computer programproduct comprising a computer readable medium comprising code, e.g.,individual code for each component, for causing at least one computer,e.g., processor 1208, to implement the functions to which the componentscorrespond.

Completely hardware based or completely software based components may beused. However, it should be appreciated that any combination of softwareand hardware, e.g., circuit implemented components may be used toimplement the functions. As should be appreciated, the componentsillustrated in FIGS. 11 and 12 control and/or configure the systems 1100and 1200 or elements therein respectively such as the processor 1108 and1208 to perform the functions of corresponding steps of the methods ofthe present invention, e.g., such as those illustrated and/or describedin the flowchart 1000.

An exemplary method of presenting content corresponding to anenvironment, in accordance with some embodiments comprises: displayingto a user content corresponding to a first camera position in saidenvironment; determining if the user is viewing another camera positionin said environment; and monitoring, while said user is viewing saidanother camera position, to detect user input indicating a user selectedswitch to said another camera position. In some embodiments thedetermining if the user is viewing another camera position in saidenvironment includes determining from i) a user head angle of rotation,ii) user head tilt angle or iii) both the user head angle of rotationand user head tilt angle, if said user is viewing said another cameraposition.

In some embodiments the method further comprises: determining which of aplurality of alternative camera positions the user is viewing based onat least one of the user head angle of rotation or viewer head tiltangle. In some embodiments the method further comprises: when it isdetermined that the user is viewing another camera position in saidenvironment, presenting the user an indication that the user can switchto viewing the environment from a perspective of said another cameraposition.

In some embodiments the presenting the user an indication that the usercan switch to viewing the environment from a perspective of said anothercamera position includes providing a visual indication corresponding tothe another camera position that a switch to viewing the environmentfrom the perspective of said another camera position is possible. Insome embodiments the visual indication is one of at least a change incolor or shading at the another camera position. In some embodiments thevisual indication includes text in the area of said another cameraposition putting the user on notice of the potential to switch toviewing from the perspective of said another camera position. In someembodiments the another camera position is one of a second, third orfourth camera position at a stadium. In some embodiments the environmentis a stadium or area. In some embodiments the environment includes anaudience seating area and a performance area said environment includingat least two camera positions corresponding to different audienceseating positions. In some embodiments the performance area is one of afield or a stage.

In some embodiments the method further comprises: in response to saidmonitoring detecting user input indicating a user selected switch tosaid another camera position switching from displaying to the usercontent corresponding to a first camera position in said environment todisplaying to the user content corresponding to the another cameraposition in said environment.

In some embodiments switching from displaying to the user contentcorresponding to a first camera position in said environment includesswitching from receiving and displaying a first broadcast content streamcorresponding to an output of a first stereoscopic camera pair locatedat said first camera position to receiving and displaying a secondbroadcast content stream corresponding to an output of a secondstereoscopic camera pair located at said another camera position.

In some embodiments the monitoring to detect user input indicating auser selected switch to said another camera position includes monitoringfor user input on a control input interface (e.g., touch pad or touchscreen) while said user is viewing said another camera position. In someembodiments the user input includes one or a double tap on the controlinput while the user is viewing the another camera position. In someembodiments determining if the user is viewing another camera positionin said environment includes: monitoring a current head orientation ofthe user; and determining if the head orientation indicates (e.g., bythe angle relative to the camera position of the current view) whetherthe user is viewing the another camera position.

In some embodiments the method further comprises: determining, prior topresenting the user an indication that the user can switch to viewingthe environment from a perspective of said another camera position, ifthe user was viewing said another camera position for a predeterminedtime. In some embodiments presenting the user said indication iscontingent on determining that the user was viewing said another cameraposition for the predetermined time.

In some embodiments the method further comprises: eliminating theindication that the user can switch to viewing the environment from aperspective of said another camera position if said monitoring, whilesaid user is viewing said another camera position, fails to detect userinput indicating a user selected switch to said another camera positionwithin a predetermined time of the start of presenting the user theindication.

An exemplary interactive system, e.g., such as the rendering andplayback system 1200, for presenting content corresponding to anenvironment, comprises: a display device; a display controllerconfigured to control displaying, to a user on said display device, ofcontent corresponding to a first camera position in said environment; auser view determination component configured to determine if the user isviewing another camera position in said environment; and a monitoringcomponent configured to monitor, while said user is viewing said anothercamera position, to detect user input indicating a user selected switchto said another camera position.

In some embodiments the user view determination component is configuredto determine from i) a user head angle of rotation, ii) user head tiltangle or iii) both the user head angle of rotation and user head tiltangle, if said user is viewing said another camera position. In someembodiments the system further comprises: a camera positiondetermination component configured to determine which of a plurality ofalternative camera positions the user is viewing based on at least oneof said user head angle of rotation or user head tilt angle.

In some embodiments the system the display controller is furtherconfigured to control presenting, on said display device, of anindication to the user that the user can switch to viewing theenvironment from a perspective of said another camera position when itis determined that the user is viewing another camera position in saidenvironment. In some embodiments the display controller is furtherconfigured to control presenting of a visual indication corresponding tothe another camera position, on said display device, indicating that aswitch to viewing the environment from the perspective of said anothercamera position is possible, as part of being configured to present theuser an indication that the user can switch to viewing the environmentfrom a perspective of said another camera position.

In some embodiments the system further comprises: a switch controllerconfigured to control the system to switch from displaying, on saiddisplay device, content corresponding to a first camera position in saidenvironment to displaying to the user content corresponding to theanother camera position in said environment, in response to saidmonitoring component detecting user input indicating a user selectedswitch to said another camera position. In some embodiments the switchcontroller is further configured, as part of being configured to switchfrom displaying content corresponding to a first camera position todisplaying content corresponding to said another camera position, tocontrol the system to switch from receiving and displaying a firstbroadcast content stream corresponding to an output of a firststereoscopic camera pair located at said first camera position toreceiving and displaying a second broadcast content stream correspondingto an output of a second stereoscopic camera pair located at saidanother camera position.

In some embodiments the system further comprises: a control inputinterface. In some embodiments the monitoring component is configured tomonitor to detect user input indicating a user selected switch to saidanother camera position on said control input interface while said useris viewing said another camera position.

In some embodiments the user view determination component is furtherconfigured to: monitor the current head orientation of the user; anddetermine if the head orientation indicates whether the user is viewingthe another camera position. In some embodiments the system furthercomprises: a timer configured to determine if the user was viewing saidanother camera position for a predetermined time. In some embodimentsthe display controller is configured to control presenting, on saiddisplay device, of said indication to the user that the user can switchto viewing the environment from a perspective of said another cameraposition contingent upon a determination by said timer that the user wasviewing said another camera position for the predetermined time. In someembodiments the display controller is configured to eliminate theindication that the user can switch to viewing the environment from aperspective of said another camera position if said monitoring componentfails to detect user input indicating a user selected switch to saidanother camera position within a predetermined time of the start ofpresenting the user the indication.

In various embodiments, to take advantage of the tilted screens, theimages, e.g., left and right eye images to be displayed on correspondingportions of a display or displays are resized to occupy the area of thetilted screen. Since in many cases the screens are tilted in onedirection and not both, the rescaling will result in a distortion of theaspect ratio of the original image. However, while the displayed imagewill be larger in the direction in which the screen is titled, thevertical or horizontal size of the viewing area when viewed head on willbe the same as that which would have been viewed if the image were notdistorted to occupy the area of the tilted screen with the perceivedresolution in the dimension in which the screen is titled being higherthan the dimension in which the screen is not angled relative to theuser's eyes. For example if the screen is titled vertically, thevertical view will have a higher perceived resolution, e.g., more dotsper inch, than the horizontal dimension which will extend parallel tothe user's face due to the larger numbers of light emitting elements perinch which are visible to the viewer in the vertical dimension. In thecase where the left and right display areas of one or more screens areangled, e.g., not parallel to the users face, in the horizontaldirection relative to a user's face, the horizontal dimension will havea higher resolution, e.g., dots per inch than the vertical direction,and the displayed image will be scaled to fully occupy the display butwith the horizontal visible area being the same or similar to what wouldbe viewed by a user if the screen(s) were parallel to the user's eyes.

The difference between the location of an object in the left and righteye images is interpreted as a distance from the user. With an angleddisplay or displays, portions of the screen will be closer to a userthan other portions. In some, but not all embodiments, the images to bedisplayed are processed to try and compensate for the effect onperceived object depth that the difference in screen distance may have.In some embodiments objects in images are identified and the differencein positions is increased or decreased as a function of the screenlocation on which the images are to be displayed. For example objects ona screen portion further away from a user's face, e.g., eyes, may beadjusted to decrease the difference in the objects position to make themseem closer to compensate for the fact they are being displayed on adisplay portion further away from another portion of the display closerto the user's face and eyes. Similarly objects to be displayed on ascreen portion closer to a user's face, e.g., eyes, may be adjusted toincrease the difference in the objects position between the left andright eyes to make them seem further away to compensate for the factthey are being displayed on a display portion closer to the user's faceand eyes than another portion of the display used to display otherobjects. In this manner when displaying 3D image content parallaxadjustments may be, and sometimes are, made to compensate for thedifference in distance, of different portions of the display or displaysdue to the use of a tilted display or displays, from a user's faceand/or eyes.

FIG. 20, comprising the combination of FIG. 20A and FIG. 20B, is aflowchart 2000 of an exemplary method of processing and displayingimages on one or more displays in accordance with an exemplaryembodiment. In some exemplary embodiments, the method of flowchart 2000is performed by a system, e.g., a rendering and display system includinga processor and one or more displays, e.g., one or more angle mounted,e.g., rotated or tilted, displays included as part of a head mounteddisplay assembly, e.g., a stereoscopic head mounted display assembly. Insome embodiments, the system implementing the method of flowchart 2000includes a head mounted display assembly which is a device including oneor more angle mounted displays, a receiver, a processor and/or circuitswhich perform steps of the exemplary method. In some embodiments, thesystem implementing the method of flowchart 2000 includes: i) a headmounted display assembly which is a device including one or more anglemounted displays and a receiver and ii) an image processing andrendering device including a receiver, an processor and/or circuits,which performs image processing including object identification andimage transformation operations, and a transmitter, said head mounteddisplay assembly device coupled to said image processing and renderingdevice, e.g., via a wired or wireless communications channel.

In some exemplary embodiments, the method of flowchart 2000 is performedby rendering and playback system 1200, e.g., a device, of FIG. 12including processor 1208 and display 1202 and/or display 1203. Operationstarts in step 2002 in which the system is powered on and initialized.Operation proceeds from step 2002 to step 2004 and step 2006. In step2002 the system receives a left eye image, and in step 2006 the systemreceives a right eye image. Operation proceeds from step 2004 and step2006 to step 2008. In step 2008 the system identifies one or moreobjects that are present in both the left eye image and the right eyeimage. Operation proceeds from step 2008 to step 2010 and, viaconnecting node A 2012, to step 2014.

In step 2010 the system transforms the left eye image as a function of aleft eye image display area arranged at an angle relative to a user'sleft eye to generate a transformed left eye image, said transformingincluding scaling the left eye image as a function of the left eye imagedisplay area. In some embodiments, the angle is greater than 0 degreesand less than 45 degrees. In some embodiments, the magnitude of theangle, expressed in degrees, is greater than 0 and less than 45. In someembodiments, the angle is greater than 45 degrees and less than 90degrees. In some embodiments, the magnitude of the angle, expressed indegrees, is greater than 45 and less than 90. In some embodiments, theangle is greater than 90 degrees and less than 135 degrees. In someembodiments, the magnitude of the angle, expressed in degrees, isgreater than 90 and less than 135.

In various embodiments, step 2016 includes one or both of steps 2016 and2018. In step 2016 the system modifies the position of at least a firstobject that is present in both the left eye image and the right eyeimage. In some such embodiments, step 2016 includes step 2020. In step2020 the system changes the location of the first object in the left eyeimage to increase an amount of difference between the location of thefirst object in the left and right eye images or decrease the amount ofdifference between the location of the first object in the left andright eye images. In some such embodiments, step 2020 includes step 2022or step 2024. In step 2022 the system changes the location of the firstobject in the left eye image to increase an amount of difference betweenthe location of the first object in the left and right eye images basedon the distance from the user's eye at which the first object will bedisplayed to the display. For example, if the first object is on aportion of the screen closer to the viewer, e.g., due to the tilt orrotation of the display mounting, the difference in location is adjustedto increase the distance and thereby make the first object appearfurther away than if no adjustment was made. In step 2024 the systemchanges the location of the first object in the left eye image todecrease an amount of difference between the location of the firstobject in the left and right eye images based on the distance from theuser's eye at which the first object will be displayed to the display.For example, if the first object is on a portion of the screen furtheraway from the viewer, e.g., due to the tilt or rotation of the displaymounting, the difference in location is adjusted to decrease thedistance and thereby make the first object appear closer than if noobject position adjustment was made.

In step 2018 the system scales the left eye image to alter the aspectratio of the left eye image as a function of the angle at which thedisplay is mounted, said angle being a non 90 degree angle.

In some embodiments, step 2018 includes step 2026. In step 2026 thesystem scales the left eye image to fully occupy the left image displayarea which is positioned at an angle relative to the user's left eye,said scaling altering the aspect ratio of the left eye image area. Insome embodiments, step 2026 includes steps 2028 or 2030.

In step 2028 the system scales the left eye image by an amount in thevertical direction which is a function of the length of the display,corresponding to the left eye, as it extends vertically along said anglerelative to the user's eye, said angle being an angle which is a non 90degree angle. For example, if the display screen is sloped in thevertical direction, e.g., with a tilt, the image will be scaled to belonger in the vertical direction than if the image was displayed on avertically mounted screen at 90 degrees relative to the user's eyes.FIGS. 7, 13, 14, 15, and 16 illustrate examples of tilted left eyedisplays or tilted left eye display portions (713, left eyed displayportion of 1313, left eye display portion of 1413, 1513, left eyedisplay portion of 1613); FIG. 4 illustrates an untilted left eyedisplay 413. FIG. 18 illustrates an exemplary display, e.g., display B1802, intended to be mounted with tilt, e.g., for which scaling inaccordance with step 2028 is performed.

In step 2030 the system scales the left eye image by an amount in thehorizontal direction which is a function of the length of the display asit extends horizontal along said angle relative to the user's eye, saidangle being an angle which is a non 90 degree angle. For example, if thedisplay screen is sloped in the horizontal direction, e.g., with arotation about the vertical axis, the image will be scaled to be longerin the horizontal direction than if the image was displayed on avertically mounted unrotated screen at 90 degrees relative to the user'seyes. FIGS. 5 and 6 illustrate examples of rotated left eye displays513, 613; and FIG. 4 illustrates an unrotated left eye display 413. FIG.19 illustrates a display, e.g., display C 1902, intended to be mountedwith rotation, e.g., for which scaling in accordance with step 2030 isto be performed.

In step 2014 the system transforms the right eye image as a function ofa right eye image display area arranged at an angle relative to a user'sright eye to generate a transformed right eye image, said transformingincluding scaling the right eye image as a function of the right eyeimage display area. In some embodiments, the angle is greater than 0degrees and less than 45 degrees. In some embodiments, the magnitude ofthe angle, expressed in degrees, is greater than 0 and less than 45. Insome embodiments, the angle is greater than 45 degrees and less than 90degrees. In some embodiments, the magnitude of the angle, expressed indegrees, is greater than 45 and less than 90. In some embodiments, theangle is greater than 90 degrees and less than 135 degrees. In someembodiments, the magnitude of the angle, expressed in degrees, isgreater than 90 and less than 135.

In some embodiments, the angle, e.g., of step 2010, relative to theuser's left eye, is the same as the angle, e.g., of step 2014, relativeto the user's right eye. In some embodiments, the angle relative to theuser's left eye is the negative of the angle relative to the user'sright eye.

In various embodiments, step 2014 includes one or both of steps 2032 and2034. In step 2032 the system modifies the position of at least thefirst object in the right eye image. In some embodiments, step 2032includes step 2036. In step 2036 the system changes the location of thefirst object in the right eye image to increase an amount of differencebetween the location of the first object in the left and right eyeimages or decrease the amount of difference between the location of thefirst object in the left and right eye images. In some embodiments, step2036 includes step 2038 or step 2030. In step 2038 the system changesthe location of the first object in the right eye image to increase anamount of difference between the location of the first object in theleft and right eye images based on the distance from the user's eye atwhich the first object will be displayed to the display. For example, ifthe first object is on a portion of the screen closer to the viewer,e.g., due to the tilt or rotation of the display mounting, thedifference in location is adjusted to increase the distance and therebymake the first object appear further away than if no adjustment wasmade. In step 2030 the system changes the location of the first objectin the right eye image to decrease an amount of difference between thelocation of the first object in the left and right eye images based onthe distance from the user's eye at which the first object will bedisplayed to the display. For example, if the first object is on aportion of the screen further away from the viewer, e.g., due to thetilt or rotation of the display mounting, the difference in location isadjusted to decrease the distance and thereby make the first objectappear closer than if no object position adjustment was made.

In step 2034 the system scales the right eye image to alter the aspectratio of the right eye image as a function of the angle at which thedisplay is mounted, said angle being a non 90 degree angle. In someembodiments, step 2034 includes step 2042. In step 2042 the systemscales the right eye image to fully occupy the right image display areawhich is positioned at an angle relative to the user's right eye, saidscaling altering the aspect ratio of the right eye image area. In someembodiments, step 2042 includes steps 2044 or 2046.

In step 2044 the system scales the right eye image by an amount in thevertical direction which is a function of the length of the display asit extends vertically along said angle relative to the user's eye, saidangle being an angle which is a non 90 degree angle. For example, if thedisplay screen is sloped in the vertical direction, e.g., with a tilt,the image will be scaled to be longer in the vertical direction than ifthe image was displayed on a vertically mounted screen at 90 degreesrelative to the user's eyes. FIGS. 7, 13, 14, 15, and 16 illustrateexamples of tilted right eye displays or tilted right eye displayportions (714, right eye display portion of 1313, right eye displayportion of 1413, 1515, right eye display portion of 1613); FIG. 4illustrates an untilted right eye display 415. FIG. 18 illustrates anexemplary display intended to be mounted with tilt. FIG. 18 illustratesa display for which scaling in accordance with step 2044 is performed.

In step 2046 the system scales the right eye image by an amount in thehorizontal direction which is a function of the length of the display asit extends horizontal along said angle relative to the user's eye, saidangle being an angle which is a non 90 degree angle. For example, if thedisplay screen is sloped in the horizontal direction, e.g., with arotation about the vertical axis, the image will be scaled to be longerin the horizontal direction than if the image was displayed on avertically mounted unrotated screen at 90 degrees relative to the user'seyes. FIGS. 5 and 6 illustrate examples of rotated right eye displays515, 615; and FIG. 4 illustrates an unrotated right eye display 415.FIG. 19 illustrates an exemplary display intended to be mounted with arotation. FIG. 19 illustrates a display for which scaling in accordancewith step 2046 is performed.

Operation proceeds from step 2010, via connecting node B 2031, and fromstep 2014, to step 2048. In step 2048 the system displays thetransformed left eye image on the left eye image display area anddisplays the transformed right eye image on the right eye image displayarea.

In some embodiments, said left eye image display area corresponds to aleft eye image display; said right eye image display area corresponds toa right eye image display, said left eye image display and said righteye image display being different physical components. For example, theembodiments of FIGS. 5, 6, 7 and 15 illustrate exemplary left eyedisplays (513, 613, 713, 1513), and exemplary right eye displays (515,615, 715, 1515). In one embodiment displays 513 and 515 are each thesize of display 1902. In one embodiment displays 613 and 615 are eachthe size of display 1902. In one embodiment displays 713 and 715 areeach the size of display 1802. In one embodiment displays 1513 and 1515are each the size of display 1802.

In some embodiments, said left eye image display area corresponds to afirst portion of a display; and said right eye image display areacorresponds to a second portion of said display, said first and secondportions being non-overlapping. For example, in some embodiments, thedisplay is display 1313 of FIG. 13 or display 1413 of FIG. 14 anddifferent non-overlapping portions of the display are used to displaythe transformed left and right eye images. In one embodiment display1313 is the size of display 1802. In one embodiment display 1413 is thesize of display 1802. Operation proceeds from step 2048, via connectingnode C 2050 to steps 2004 and 2006.

In some embodiments, the left eye image display area and the right eyeimage display area are inclined vertically, e.g., as shown in FIGS. 7,13, 14, 15, and 16. In some embodiments, the left eye image display areaand the right eye image display area are rotated, e.g., about a verticalaxis, as shown in FIGS. 5 and 6, so that they are angled horizontallyrelative to a user's eye.

In various embodiments, in step 2008 the system identifies multipleobjects that are present in both the received left eye image and thereceived right eye image; and in step 2016 the system modifies thepositions of a first set of objects included in said identified multipleobjects in the left eye image; and in step 2032 the system modifies thepositions of the first set of objects in the right eye image. Some ofthe objects in the first set of objects may be moved to increase anamount of difference between the location of the object in the left andright eye images, while other ones of the objects in the first set ofobjects may be moved to decrease an amount of difference between thelocation of the object in the left and right eye images. In someembodiments, object movement direction and amount is determined as afunction of the distance from a user's eye to the location on the tiltedand/or rotated display screen on which the object is mapped to appear.

In some embodiments the method of flowchart 2000 is implemented by anyof: system 122 of FIG. 1, system 124 of FIG. 1, system 200 of FIG. 2including display and processing capability, system 200 of FIG. 2including display and processing capabilities, system 300 of FIG. 3,system 200″ of FIG. 5 including display and processing capabilities,system 200′″ of FIG. 6 including display and processing capabilities,system 200″″ of FIG. 7 including display and processing capabilities,system 200′″″ of FIG. 8 including display and processing capabilities,system 200″″″ of FIG. 9 including display and processing capabilities,the system of FIG. 13 including display and processing capabilities, thesystem of FIG. 14 including display and processing capabilities, thesystem of FIG. 15 including display and processing capabilities, thesystem of FIG. 16 including display and processing capabilities, system200 of FIG. 2 including display capabilities and a rendering andplayback device, system 200″ of FIG. 5 including display capabilitiesand a rendering and playback device, system 200′″ of FIG. 6 includingdisplay capabilities and a rendering and playback device, system 200″″of FIG. 7 including display capabilities and a rendering and playbackdevice, system 200′″″ of FIG. 8 including display capabilities and arendering and playback device, system 200″″″ of FIG. 9 including displaycapabilities and a rendering and playback device, the system of FIG. 13including display capabilities and a rendering and playback device, thesystem of FIG. 14 including display capabilities and a rendering andplayback device, the system of FIG. 15 display capabilities and arendering device.

FIG. 21, comprising the combination of FIG. 21A and FIG. 21B, is adrawing of an assembly of components 2100, comprising the combination ofPart A 2101 and Part B 2103, in accordance with an exemplary embodiment.In one embodiment, exemplary assembly of components 2100 is assembly ofcomponents 1207 in system 1200. In one embodiment, exemplary assembly ofcomponents 2100 is assembly of components 1250 in memory 1212 of system1200. In one embodiment, assembly of components 2100 is included inprocessor 1208. Exemplary assembly of components 2100 is included in anexemplary rendering and playback system, e.g., any of the exemplaryrendering and playback systems shown and/or described in the Figuresand/or corresponding text.

Assembly of components 2100 may be included in an exemplary renderingand playback system 1200. The components in the assembly of components2100 can, and in some embodiments are, implemented fully in hardwarewithin a processor, e.g., processor 1208, e.g., as individual circuits.The components in the assembly of components 2100 can, and in someembodiments are, implemented fully in hardware within the assembly ofhardware components 1207, e.g., as individual circuits corresponding tothe different components. In other embodiments some of the componentsare implemented, e.g., as circuits, within processor 1208 with othercomponents being implemented, e.g., as circuits within assembly ofcomponents 1207, external to and coupled to the processor 1208. Asshould be appreciated the level of integration of components on theprocessor and/or with some components being external to the processormay be one of design choice. Alternatively, rather than beingimplemented as circuits, all or some of the components may beimplemented in software and stored in the memory 1212 of the system1200, with the components controlling operation of system 1200 toimplement the functions corresponding to the components when thecomponents are executed by a processor e.g., processor 1208. In somesuch embodiments, the assembly of components 2100 is included in thememory 1212 as assembly of software components 1250. In still otherembodiments, various components in assembly of components 2100 areimplemented as a combination of hardware and software, e.g., withanother circuit external to the processor providing input to theprocessor which then under software control operates to perform aportion of a component's function.

When implemented in software the components include code, which whenexecuted by a processor, e.g., processor 1208, configure the processorto implement the function corresponding to the component. In embodimentswhere the assembly of components 2100 is stored in the memory 1212, thememory 1212 is a computer program product comprising a computer readablemedium comprising code, e.g., individual code for each component, forcausing at least one computer, e.g., processor 1208, to implement thefunctions to which the components correspond.

Completely hardware based or completely software based components may beused. However, it should be appreciated that any combination of softwareand hardware, e.g., circuit implemented components may be used toimplement the functions. As should be appreciated, the componentsillustrated in FIG. 21 control and/or configure the system 1200 orelements therein such as the processor 1208, to perform the functions ofcorresponding steps illustrated and/or described in the method of one ormore of the flowchart 2000 and/or described with respect to any of theFigures. Thus the assembly of components 2100 includes variouscomponents that perform functions of corresponding one or more describedand/or illustrated steps of an exemplary method, e.g., one or more stepsof the method of FIG. 20.

Assembly of components 2100 includes a component 2104 configured tocontrol a receiver to receive a left eye image, a component 2106configured to control a receiver to receive a right eye image, acomponent 2108 configured to identify one or more objects that arepresent in both the left and right eye images, a component 2110configured to transform the left eye image as a function of a left eyeimage display array arranged at an angle relative to a user's left eye,to generate a transformed left eye image, said transforming includingscaling the left eye image as a function of the left eye image displayarea, a component 2114 configured to transform the right eye image as afunction of a right eye image display area arrange at an angle relativeto a user's right eye to generate a transformed right eye image, saidtransforming include scaling the right eye image as a function of theright eye image display area, and a component 2148 configured to controla display to display the transformed left eye image on the left eyeimage display area and control a display to display the transformedright eye image on the right eye image display area.

Component 2110 includes a component 2116 configured to modify theposition of at least a first object that is present in both the left eyeimage and the right eye image and a component 2118 configured to scalethe left eye image to alter the aspect ratio of the left eye image as afunction of the angle at which the display is mounted, said angle beinga non 90 degree angle. Component 2116 includes a component 2120configured to change the location of an object, e.g., the first object,in the left eye image to increase an amount of difference between thelocation of the object, e.g., the first object, in the left and righteye images or decrease the amount of difference between the location ofthe object, e.g. the first object, in the left and right eye images.Component 2120 includes a component 2122 configured to change thelocation of an object, e.g., the first object, in the left eye image toincrease an amount of difference between the location of the object,e.g., the first object, in the left and right eye images based on thedistance from the user's eye at which the object, e.g., the firstobject, will be displayed on the display and a component 2124 configuredto change the location of an object, e.g., the first object, in the lefteye image to decrease an amount of difference between the location ofthe object, e.g., the first object, in the left and right eye imagesbased on the distance from the user's eye at which the object, e.g., thefirst object, will be displayed on the display.

Component 2118 includes a component 2126 configured to scale the lefteye image to fully occupy the left eye image display area which ispositioned at an angle relative to the user's left eye, said scalingaltering the aspect ratio of the left eye image. Component 2126 includesa component 2128 configured to scale the left eye image by an amount inthe vertical direction which is a function of the length of the displayas it extends vertically along said angle relative to the user's eye,said angle being an angle which is a non 90 degree angle, and acomponent 2130 configured to scale the left eye image by an amount inthe horizontal direction which is a function of the length of thedisplay as it extends horizontal along said angle relative to the user'seye, said angle being a non 90 degree angle.

Component 2114 includes a component 2132 configured to modify theposition of at least a first object in the right eye image and acomponent 2134 configured to scale the right eye image to alter theaspect ratio of the right eye image as a function of the angle at whichthe display is mounted, said angle being a non 90 degree angle.Component 2132 includes a component 2136 configured to change thelocation of an object, e.g., the first object, in the right eye image toincrease an amount of difference between the location of the object,e.g., the first object, in the left and right eye images or decrease theamount of difference between the location of the object, e.g. the firstobject, in the left and right eye images. Component 2136 includes acomponent 2138 configured to change the location of an object, e.g., thefirst object, in the right eye image to increase an amount of differencebetween the location of the object, e.g., the first object, in the leftand right eye images based on the distance from the user's eye at whichthe object, e.g., the first object, will be displayed on the display anda component 2140 configured to change the location of an object, e.g.,the first object, in the right eye image to decrease an amount ofdifference between the location of the object, e.g., the first object,in the left and right eye images based on the distance from the user'seye at which the object, e.g., the first object, will be displayed onthe display.

Component 2134 includes a component 2142 configured to scale the righteye image to fully occupy the right eye image display area which ispositioned at an angle relative to the user's right eye, said scalingaltering the aspect ratio of the right eye image. Component 2142includes a component 2144 configured to scale the right eye image by anamount in the vertical direction which is a function of the length ofthe display as it extends vertically along said angle relative to theuser's eye, said angle being an angle which is a non 90 degree angle,and a component 2146 configured to scale the right eye image by anamount in the horizontal direction which is a function of the length ofthe display as it extends horizontal along said angle relative to theuser's eye, said angle being a non 90 degree angle.

FIG. 22 is a drawing of exemplary data/information 2200 in accordancewith an exemplary embodiment. Exemplary data/information 2200 is, e.g.,data/information 1252 of FIG. 12. Data/information 2200 includes areceived left eye image 2202, a received right eye image 2204, a lefteye image display area 2206, a left eye image display tilt or rotationmounting angle 2208, a right eye image display area 2210, a right eyeimage display tilt or rotation mounting angle 2212, identified objectsin both left and right eye images 2214, locations of identified objects2216, determinations as to direction and amount to move each identifiedobject 2218, and determined changed location of identified objects 2220.Data/information 2200 further includes an aspect ratio of a receivedleft eye image 2222, scaling information for the left eye image 2224, anaspect ratio of the scaled left eye image 2226, an aspect ratio of thereceived right eye image 2228, scaling information for the right eyeimage 2230, an aspect ratio of the scaled right eye image 2232, atransformed left eye image 2234, and a transformed right eye image 2236.

Several lists of exemplary numbered embodiments are included below. Theembodiment numbering within a list pertains to that particular list.

First List of Exemplary Numbered System Embodiments:

System Embodiment 1 A system (200, 200″,200′″, or 200″″), the systemcomprising: a headmount assembly (202, 502, 602 or 702); and a firstdisplay (213, 513, 613 or 713) included in the headmount assembly (202,502, 602 or 702) and mounted at an angle relative of a user's eyeposition.

System Embodiment 2 The system (200, 200″,200′″, or 200″″) of SystemEmbodiment 1, wherein the first display (213, 513, 613 or 713) is a lefteye display; and wherein the system (200, 200″,200′″, or 200″″) furthercomprises: a second display (215, 515, 615 or 715) included in theheadmount assembly (202, 502, 602 or 702) and mounted at an anglerelative of a user's right eye position.

System Embodiment 3 The system (200, 200″,200′″, or 200″″) of SystemEmbodiment 2, further comprising: a first lens (210, 510, 610, 710)positioned between the first display (213, 513, 613 or 713) and theuser's left eye position.

System Embodiment 4 The system (200, 200″,200′″, or 200″″) of claim 3,further comprising: a second lens (212, 512, 612 or 712) positionedbetween the second display (215, 515, 615 or 715) and the user's righteye position.

System Embodiment 5 The system (200, 200″,200′″, or 200″″) of SystemEmbodiment 4, wherein the headmount assembly (202, 502, 602 or 702)includes a display housing (203, 503, 603 or 703); and wherein the firstand second displays ((213, 215), (513, 515), (613, 615), or (713, 715))are mounted in said display housing (203, 503, 603 or 703).

System Embodiment 6 The system (200, 200″,200′″, or 200″″) of claim 5,wherein the headmount assembly (202, 502, 602 or 702) further includes astrap (208, 508, 608 or 708) for securing the display housing (203, 503,603, or 703) to a user's head.

System Embodiment 7 The system (200, 200″,200′″, or 200″″) of claim 1,wherein the angle is a non 90 degree angle relative to a bottom (256) orside ((250 or 252), (550 or 552), (650 or 652) of the display housing(203, 503, 603 or 703).

System Embodiment 8 A system (1602), the system comprising: a displayhousing (1603); and a first display (1613) mounted in said displayhousing (1603) at an angle relative to a viewing surface (1610) throughwhich the first display (1613) can be viewed.

System Embodiment 9 The system (1602) of System Embodiment 8, whereinsaid viewing surface (1610) is a glass or plastic surface through whichthe first display (1613) can be viewed.

System Embodiment 10 The system (1602) of System Embodiment 8, whereinthe display housing (1603) is part of an automated teller machine (ATM)or vehicle dashboard (1601).

LIST OF SET OF EXEMPLARY NUMBERED METHOD EMBODIMENTS:

Method Embodiment 1 A method of processing and displaying images on oneor more displays, the method comprising: receiving a left eye image;receiving a right eye image; transforming the left eye image as afunction of a left eye image display area arranged at an angle relativeto a user's left eye to generate a transformed left eye image, saidtransforming including scaling the left eye image as a function of theleft eye image display area; transforming the right eye image as afunction of a right eye image display area arranged at an angle relativeto the user's right eye to generate a transformed right eye image, saidtransforming the right eye image including scaling the right eye imageas a function of a right eye image display area; and displaying thetransformed left eye image on the left eye image display area anddisplaying the transformed right eye image on the right eye imagedisplay area.

Method Embodiment 2 The method of Method Embodiment 1, wherein saidangle is greater than 0 and less than 45 degrees.

Method Embodiment 3 The method of Method Embodiment 1, wherein saidscaling of the left eye image alters the aspect ratio of the left eyeimage as a function of the angle at which the display is mounted, saidangle being a non 90 degree angle.

Method Embodiment 4 The method of Method Embodiment 1, wherein the lefteye image display area is inclined vertically; wherein said receivedleft eye image has a first aspect ratio (height to width ratio); andwherein said scaling the left eye image includes scaling the left eyeimage to fully occupy the left eye image display area which ispositioned at an angle relative to the user's left eye, said scalingaltering the aspect ratio of the left eye image.

Method Embodiment 5 The method of Method Embodiment 4, wherein scalingthe left eye image is by an amount in the vertical direction which is afunction of the length of the display as it extends vertically alongsaid angle relative to the user's eye, said angle being an angle whichis a non 90 degree angle.

Method Embodiment 6 The method of Method Embodiment 3, wherein the lefteye display area is angled horizontally relative to the user's left eye;and wherein scaling the left eye image is by an amount in the horizontaldirection which is a function of the length of the display as it extendshorizontally along said angle relative to the user's left eye, saidangle being an angle which is a non 90 degree angle.

Method Embodiment 7 The method of Method Embodiment 3, furthercomprising: identifying one or more objects that are present in both theleft eye image and right eye image; and wherein transforming the lefteye image further includes modifying the position of at least a firstobject that is present in both the left eye image and right eye image inthe left eye image; and wherein transforming the right eye image furtherincludes modifying the position of at least said first object in theright eye image.

Method Embodiment 8 The method of Method Embodiment 7, wherein modifyingthe position of the first object in the left eye image includes changingthe location of the first object in said left eye image to increase anamount of difference between the locations of the first object in theleft and right eye images or decrease the amount of difference betweenthe locations of the first object in the left and right eye images; andwherein modifying the position of the first object in the right eyeimage includes changing the location of the first object in said righteye image to increase an amount of difference between the locations ofthe first object in the left and right eye images or decrease the amountof difference between the locations of the first object in the left andright eye images.

Method Embodiment 9 The method of Method Embodiment 8, wherein modifyingthe position of the first object in the left eye image includes changingthe location of the first object in the left image to increase thedifference based on the distance from the user's eye at which the firstobject will be displayed on the display; and wherein modifying theposition of the first object in the right eye image includes changingthe location of the first object in the right image to increase thedifference based on the distance from the user's eye at which the firstobject will be displayed on the display.

Method Embodiment 10 The method of Method Embodiment 8, whereinmodifying the position of the first object in the left eye imageincludes changing the location of the first object in the left image todecrease the difference based on the distance from the user's eye atwhich the first object will be displayed on the display; and whereinmodifying the position of the first object in the right eye imageincludes changing the location of the first object in the right image todecrease the difference based on the distance from the user's eye atwhich the first object will be displayed on the display.

Method Embodiment 11 The method of Method Embodiment 1, wherein saidleft eye image display area corresponds to a left eye image display; andwherein said right eye image display area corresponds to a right eyeimage display, said left eye image display and said right eye imagedisplay being different physical components.

Method Embodiment 12 The method of Method Embodiment 1, wherein saidleft eye image display is the same size as said right eye image display.

Method Embodiment 13 The method of Method Embodiment 1, wherein saidleft eye image display area corresponds to a first portion of a display;and wherein said right eye image display area corresponds to a secondportion of said display, said first and second portions beingnon-overlapping.

Second List of Set of Exemplary Numbered System Embodiments:

System Embodiment 1 A system for processing and displaying images on oneor more displays, the system comprising: a processor (1208) configuredto: receive a left eye image; receive a right eye image; transform theleft eye image as a function of a left eye image display area arrangedat an angle relative to a user's left eye to generate a transformed lefteye image, said transforming including scaling the left eye image as afunction of the left eye image display area; transform the right eyeimage as a function of a right eye image display area arranged at anangle relative to the user's right eye to generate a transformed righteye image, said transforming the right eye image including scaling theright eye image as a function of a right eye image display area; anddisplay the transformed left eye image on the left eye image displayarea and display the transformed right eye image on the right eye imagedisplay area.

System Embodiment 2 The system of System Embodiment 1, wherein saidangle is greater than 0 and less than 45 degrees.

System Embodiment 3 The system of System Embodiment 1, wherein saidscaling of the left eye image alters the aspect ratio of the left eyeimage as a function of the angle at which the display is mounted, saidangle being a non 90 degree angle.

System Embodiment 4 The system of System Embodiment 1, wherein the lefteye image display area is inclined vertically; wherein said receivedleft eye image has a first aspect ratio (height to width ratio); andwherein said scaling the left eye image includes scaling the left eyeimage to fully occupy the left eye image display area which ispositioned at an angle relative to the user's left eye, said scalingaltering the aspect ratio of the left eye image.

System Embodiment 5 The system of System Embodiment 4, wherein scalingthe left eye image is by an amount in the vertical direction which is afunction of the length of the display as it extends vertically alongsaid angle relative to the user's eye, said angle being an angle whichis a non 90 degree angle.

System Embodiment 6 The system of System Embodiment 3, wherein the lefteye display area is angled horizontally relative to the user's left eye;and wherein scaling the left eye image is by an amount in the horizontaldirection which is a function of the length of the display as it extendshorizontally along said angle relative to the user's left eye, saidangle being an angle which is a non 90 degree angle.

System Embodiment 7 The system of System Embodiment 3, furthercomprising: identifying one or more objects that are present in both theleft eye image and right eye image; and wherein transforming the lefteye image further includes modifying the position of at least a firstobject that is present in both the left eye image and right eye image inthe left eye image; and wherein transforming the right eye image furtherincludes modifying the position of at least said first object in theright eye image.

System Embodiment 8 The system of System Embodiment 7, wherein modifyingthe position of the first object in the left eye image includes changingthe location of the first object in said left eye image to increase anamount of difference between the locations of the first object in theleft and right eye images or decrease the amount of difference betweenthe locations of the first object in the left and right eye images; andwherein modifying the position of the first object in the right eyeimage includes changing the location of the first object in said righteye image to increase an amount of difference between the locations ofthe first object in the left and right eye images or decrease the amountof difference between the locations of the first object in the left andright eye images.

System Embodiment 9 The system of System Embodiment 8, wherein modifyingthe position of the first object in the left eye image includes changingthe location of the first object in the left image to increase thedifference based on the distance from the user's eye at which the firstobject will be displayed on the display; and wherein modifying theposition of the first object in the right eye image includes changingthe location of the first object in the right image to increase thedifference based on the distance from the user's eye at which the firstobject will be displayed on the display.

System Embodiment 10 The system of System Embodiment 8, whereinmodifying the position of the first object in the left eye imageincludes changing the location of the first object in the left image todecrease the difference based on the distance from the user's eye atwhich the first object will be displayed on the display; and whereinmodifying the position of the first object in the right eye imageincludes changing the location of the first object in the right image todecrease the difference based on the distance from the user's eye atwhich the first object will be displayed on the display.

System Embodiment 11 The system of System Embodiment 1, furthercomprising: a left eye image display; and a right eye image display;wherein said left eye image display area corresponds to the left eyeimage display; and wherein said right eye image display area correspondsto the right eye image display.

System Embodiment 12 The system of System Embodiment 1, furthercomprising: a display; wherein said left eye image display areacorresponds to a first portion of said display; and wherein said righteye image display area corresponds to a second portion of display, saidfirst and second portions being non-overlapping.

List of Set of Exemplary Numbered Computer Readable Medium Embodiments:

Computer Readable Medium Embodiment 1 A non-transitory computer readablemedium including computer executable instructions which when executed byone or more processors of a rendering and playback system cause therendering and playback system to perform the steps of: receiving a lefteye image; receiving a right eye image; transforming the left eye imageas a function of a left eye image display area arranged at an anglerelative to a user's left eye to generate a transformed left eye image,said transforming including scaling the left eye image as a function ofthe left eye image display area; transforming the right eye image as afunction of a right eye image display area arranged at an angle relativeto the user's right eye to generate a transformed right eye image, saidtransforming the right eye image including scaling the right eye imageas a function of a right eye image display area; and displaying thetransformed left eye image on the left eye image display area anddisplaying the transformed right eye image on the right eye imagedisplay area.

Some embodiments are directed a non-transitory computer readable mediumembodying a set of software instructions, e.g., computer executableinstructions, for controlling a computer or other device to encode andcompresses stereoscopic video. Other embodiments are embodiments aredirected a computer readable medium embodying a set of softwareinstructions, e.g., computer executable instructions, for controlling acomputer or other device to decode and decompresses video on the playerend. While encoding and compression are mentioned as possible separateoperations, it should be appreciated that encoding may be used toperform compression and thus encoding may, in some include compression.Similarly, decoding may involve decompression.

The techniques of various embodiments may be implemented using software,hardware and/or a combination of software and hardware. Variousembodiments are directed to apparatus, e.g., a image data processingsystem. Various embodiments are also directed to methods, e.g., a methodof processing image data. Various embodiments are also directed to anon-transitory machine, e.g., computer, readable medium, e.g., ROM, RAM,CDs, hard discs, etc., which include machine readable instructions forcontrolling a machine to implement one or more steps of a method.

Various features of the present invention are implemented usingcomponents. Such components may, and in some embodiments are,implemented as software modules. In other embodiments the components areimplemented in hardware. In still other embodiments the components areimplemented using a combination of software and hardware. In someembodiments the components are implemented as individual circuits witheach component being implemented as a circuit for performing thefunction to which the component corresponds. A wide variety ofembodiments are contemplated including some embodiments where differentcomponents are implemented differently, e.g., some in hardware, some insoftware, and some using a combination of hardware and software. Itshould also be noted that routines and/or subroutines, or some of thesteps performed by such routines, may be implemented in dedicatedhardware as opposed to software executed on a general purpose processor.Such embodiments remain within the scope of the present invention. Manyof the above described methods or method steps can be implemented usingmachine executable instructions, such as software, included in a machinereadable medium such as a memory device, e.g., RAM, floppy disk, etc. tocontrol a machine, e.g., general purpose computer with or withoutadditional hardware, to implement all or portions of the above describedmethods. Accordingly, among other things, the present invention isdirected to a machine-readable medium including machine executableinstructions for causing a machine, e.g., processor and associatedhardware, to perform one or more of the steps of the above-describedmethod(s).

Numerous additional variations on the methods and apparatus of thevarious embodiments described above will be apparent to those skilled inthe art in view of the above description. Such variations are to beconsidered within the scope.

What is claimed is:
 1. A method of processing and displaying images onone or more displays, the method comprising: receiving a left eye image;receiving a right eye image; transforming the left eye image as afunction of a left eye image display area arranged to face a user and atan angle relative to a user's left eye to generate a transformed lefteye image, said transforming the left eye image including scaling theleft eye image by a first amount in a horizontal direction and a secondamount in a vertical direction to thereby distort the left eye image,said first and second amounts being different and being a function ofthe left eye image display area; transforming the right eye image as afunction of a right eye image display area arranged facing the user andat an angle relative to the user's right eye to generate a transformedright eye image, said transforming the right eye image including scalingthe right eye image by a third amount in a horizontal direction and afourth amount in a vertical direction to thereby distort the right eyeimage, said third and fourth amounts being different and being afunction of a right eye image display area; and displaying thetransformed left eye image on the left eye image display area anddisplaying the transformed right eye image on the right eye imagedisplay area.
 2. The method of claim 1, wherein said angle is greaterthan 0 and less than 45 degrees.
 3. The method of claim 1, wherein saidscaling of the left eye image alters the aspect ratio of the left eyeimage as a function of the angle at which the display is mounted, saidangle being a non 90 degree angle.
 4. The method of claim 1, wherein theleft eye image display area is inclined vertically; wherein saidreceived left eye image has a first aspect ratio; and wherein saidscaling the left eye image includes scaling the left eye image to fullyoccupy the left eye image display area which is positioned at an anglerelative to the user's left eye, said scaling altering the aspect ratioof the left eye image.
 5. The method of claim 4, wherein scaling theleft eye image is by an amount in the vertical direction which is afunction of the length of the display as it extends vertically alongsaid angle relative to the user's left eye, said angle being an anglewhich is a non 90 degree angle.
 6. The method of claim 4, wherein theleft eye image display area is angled horizontally relative to theuser's left eye; and wherein scaling the left eye image is by an amountin the horizontal direction which is a function of the length of thedisplay as it extends horizontally along said angle relative to theuser's left eye, said angle being an angle which is a non 90 degreeangle.
 7. The method of claim 4, further comprising: identifying a firstobject that is present in both the left eye image and right eye image;and wherein transforming the left eye image further includes modifying alocation of at least the first object in the left eye image; and whereintransforming the right eye image further includes modifying a locationof the first object in the right eye image.
 8. The method of claim 7,wherein modifying the position of the first object in the left eye imageincludes changing the location of the first object in said left eyeimage to increase an amount of difference between the location of thefirst object in the left eye image and the location of the first objectin the right eye image or decrease the amount of difference between thelocation of the first object in the left eye image and the location ofthe first object in the right eye image; and wherein modifying theposition of the first object in the right eye image includes changingthe location of the first object in said right eye image to increase anamount of difference between the location of the first object in theleft eye image and the location of the first object in the right eyeimage or decrease the amount of difference between the location of thefirst object in the left eye image and the location of the first objectin the right eye image.
 9. The method of claim 8, wherein modifying theposition of the first object in the left eye image includes changing thelocation of the first object in the left image to increase the amount ofdifference between the location of the first object in the left eyeimage and the location of the first object in the right eye image basedon the distance from the user's left eye at which the first object willbe displayed on the display; and wherein modifying the position of thefirst object in the right eye image includes changing the location ofthe first object in the right image to increase the amount of thedifference based on the distance from the user's right eye at which thefirst object will be displayed on the display.
 10. The method of claim8, wherein modifying the position of the first object in the left eyeimage includes changing the location of the first object in the leftimage to decrease the amount of difference between the location of thefirst object in the left eye image and the location of the first objectin the right eye image based on the distance from the user's left eye atwhich the first object will be displayed on the display; and whereinmodifying the position of the first object in the right eye imageincludes changing the location of the first object in the right image todecrease the difference based on the distance from the user's right eyeat which the first object will be displayed on the display.
 11. Themethod of claim 1, wherein transforming the left eye image as a functionof a left eye image display area arranged to face the user distorts theleft eye image so that when viewed by the user on the left eye imagedisplay area the user views the displayed distorted left eye image froma position where the visible portion of the displayed distorted left eyeimage has an aspect ratio which is the same as an aspect ratio of saidreceived left eye image.
 12. The method of claim 11, whereintransforming the right eye image as a function of a left eye imagedisplay area arranged to face a user distorts the right eye image sothat when viewed by the user on the right eye image display area theuser views the displayed distorted image from a position where thevisible portion of the displayed image has an aspect ratio which is thesame as an aspect ratio of said received right eye image.